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ABSTRACT 

The effects of instructional technology on learning 
are determined by the extent to which hardwere and software amplify 
the basic capabilities of an instructor. Experience indicates that 
rational considerations such as cost-effectiveness are not usually 
the primary factors in making decisions about use of technology in 
training. Most large organi^tions are using one or more technologies 
in some aspect of their training activities, interactive video, 
computers, and computer-based training are common; teleconferencing 
is just beginning to be used. Among the major obstacles to technology 
use are lack of instructor knowledge, lack of money to buy hardware 
or develop materials, lack of time to develop alternative training 
approaches, and poor reliability and usability of training systems. 
The following emerging developments are likely to affect training in 
the future t (l) widespread ownership of portable workstations; (2) 
electronic classrooms designed to support instructional technology; 
(3) products and systems with embedded training; (4) use of 
intelligent tutors and expert systems; (5) forms of interactive 
multimedia with more capacity; (6) hypertext systems; and (7) digital 
networks. A major area of research development is development of 
authoring systems and expert systems. Current and future applications 
of instructional technology relate to the following issues in the 
training fields retraining, basic skills, team training, 
participative management, and technology transfer. (Appendixes 
include a 41-item bibliography and information on military 
applications of instructional technology.) (YLB) 
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SUMMARY OP FINDINGS, CONCLUSIONS, & RECOMMENDATIONS 

Instructional technology of one form or another is becoming 
widely used in the training world. The cost of the hardware 
(e.g., personal computers, videodisc players) has become 
affordable to most large corporations. Studies have shown that 
, nstructional technology usually produces superior results to 
classroom instruction in terms of training duration, degree of 
learning achieved, and employee satisfaction. More significantly, 
the use of technology for training is often more convenient to 
deliver and administer than classroom instruction. In some 
organizations, instructional technology is providing a way to 
link training with job performance. Instructional technology is 
being embraced by many companies as a means of improving the overall 
quality of their operations. 



Of the many instructional technolooies currently in use, three 
media seem to be the most promising: videotape, interactive 
videodisc, and computer-based training. In addition, simulators 
play an increasingly important role in military training. Many 
large corporations are experimenting with televison and 
teleconferencing, but at the present time neither of these 
two technologies is used extensively. On the other hand, two 
low-technology media, print and overhead transparencies, are 
widely used in all training activities. 



Instructional technology is most commonly used in large 
corporations and DOD agencies. Large organizations can afford 
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the substantial start-up costs associated with technology and 
have the large student populations that result in favorable 
cost-benefit outcomes. Medium sized companies can afford to 
use video and computer based training because these two forms 
of instructional technology have low entry thresholds and a 
substantial amount of courseware is commercially available. 
Small companies do not currently use instructional technology 
to any significant extent partly due to the costs involved 
but mostly because they conduct little formal training. 

Obstacles to the broader use of instructional technology in 
the near-term include: (i) lack of experience usino technology 
on the part of instructors, (ii) lack of budgeted funds to 
initiate technology-based approaches, (iii) lack of time to 
prepare and develop courseware, and (iv) unreliability and poor 
usability of technology. Each of these major obstacles is being 
addressed by some component of the instructional technology 
world (universities, vendors) and by the development of better 
hardware and software. 

There are many new developments underway that are likely to 
catalyze the broader use of instructional technology as well 
as provide new capabilities. Personal computers are becoraino 
more portable, more powerful, and less expensive. As a laraer 
and larger pecentage of the Dopulation owns such a machine, 
its use for training at work and at home becomes very natural. 
Organizations will no longer have to buy the computers needed 
to deliver instruction. Electronic classrooms will make the 



use of technology much easier. Embedded training will make 

a» 

instruction an inteqral component of most computer systems and 
equipment. Intelligent tutors and expert systems will make online 
training more responsive to individual needs. Furthermore, advances 
in optical storage will allow most forms of online instruction to 
be multimedia presentations. Hypertext/Hypermedia will make huge 
databases of information easier to learn and use. Finally, the 
presence of wideband digital networks will allow all of this online 
information to be transmitted to any location at an affordable cost. 

Some long-term barriers to the use of instructional technology 
must be surmounted in order for all of these future developments 
to bs realized: (i) the lack of sophistication of training 
professionals (both instructors and managers) about instructional 
technology, (ii) the low emphasis placed upon technoloay by senior 
management and HRD departments, and (iii) the inadeguate amount of 
federal funding allocated to R&D for research in instructional 
technology. Unless training professionals know how to use, develop 
materials for, and manage instructional technology, it will not 
become a mainstream training approach. For instructional technology 
to become institutionalized, it must be a priority of both staff 
and training management. And, if we are going to discover the good 
and bad ways to use technology in training, there must be active 
and ongoing research programs. To date, OOD has supported almost 
all R&D in the instructional technology area. This needs to continue 
or another patron needs to take Its place. It is a mistake to think 
that private industry will take on this role. 

w s 



One other element that will strongly influence the success and 
rate of development of instructional technology is the continued 
evolution of author ina software. A tremendous amount of time and 
skill is required to create any form of interactive instruct* tn . 
The availability of authorinq software that can both speed up the 
process and minimize the experience required is a very important 
factor In makina instructional technoloqy affordable and cost- 
effective. Many current authorinq systems are quite powerful and 
easy to use. They make the development of CBT or interactive 
video accessible to almost any instructional designer. Research 
is now focused on the develoDment of automated instructional 
development systems that will help designers in more of the 
analysis and design tasks that are not presently automated. In 
addition, there is work being conducted to develop expert systems 
for instructional development that will comoensate for limited 
experience designing instruction. Once the«e software tools become 
widely available, the time and skill required to develop materials 
for interactive instruction should decrease further. 

It is important to examine how well current and future efforts in 
the instructional technology domain relate to major issues in the 
training field. Some of these issues include: (i) retraininq, 
(iUbasic skills, (lii) distributed training, (iv) participative 
management, (v) team training, (vi) multiculturalism, (vii) 
technology transfer, and Cviii) HRD training. This study concludes 
that instructional technology can have a favorable impact on all 
of the first six issues provided that adequate attention is given 



to the last two. In other words, as long as the results of research 
and demonstration projects involvino instructional technoloqy are 
widely disseminated and HRD professionals are properly trained 
about instructional technolooy, the major issues of workplace 
training in the coming decades will be addressed. 
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I. INTRODUCTION 



S cope & Organization of Report 

This report discusses the current and future use of instructional 
technology in the workplace, concentratinq on applications in the 
manufacturing and service industries. It also encompasses military 
applications of training technology since much of this work has 
immediate or long-term relevance to the civilian sector. The purpose 
of this analysis is to identify developments and trends that are 
likely to have a major imoact on the way trainina is conducted and 
hence the overall effectiveness of the U.S. workforce. 

The report is organized into five sections: (1) an Introduction 
which discusses the nature and history of instructional technology 
as well as cost-effectiveness, (2) The Present which provides 
an overview of current applications of instructional technology in 
the workplace, (3) The Future which summarizes R&D projects in 
instructional technology, (4) Development Tools which describes 
current efforts in the automation of training development, and 
(5) Critical Issues which discusses major training issues and 
how instructional technology relates to these issues. An Appendix 
discusses military applications of instructional technology. 

The Nature and Hi story of Instruct ional T echnology 

Instructional technology is easily misunderstood even within 
the training community. The biggest misconception is that 
technology equates to hardware. There are many serious conseouences 
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of this misconception: (1) when people plan for or implement 
technology-based projects they fail to account for all the 
non-hardware aspects, (2) by focusing on hardware only, they 
miss the components that determine success, and (3) exDectations 
about the use or effectiveness of technoloay are unrealistic. 
Indeed, hardware is often a very minor component of technology 
applications — simply the obvious tip of the iceberg that gets 
all the attention but has little to do with the total imoact. 
While the hardware is a necessary component of instructional 
technology, it is not sufficient to ensure successful training. 

A good way of understanding instructional technology is to grok 
the following equation: 

Training Accomplished ■ Skills/Knowledge x Hardware x Software 
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This equation states that the amount or quality of training 
accomplished is a function of the instructor's or instructional 
designer's skill and knowledge multipled by hardware capabilities 
multiplied by the software that drives the hardware. In other 
words, the effects of instructional technoloay on learning are 
determined by the extent to which hardware and software amplify 
the basic capabilities of an instructor. If the instructor has 
very limited skills/knowledge, there is little to amplify; on the 
other hand, if the instructor is very talented, technology can 
result in a much bigger effect. The equation also says that if 
the contribution of the software component is small, so is the 
relative effect of either the instructor or hardware. All three 
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components must be strong to get a good result (i.e., effective 
training) . 

This equation explains why the common misconception about 
instructional technology is so serious. If people fail to 
realize that hardware and software only amplify instructor 
abilities, thev miss the central role of instructors and 
instructional desianers in making technology work. If thev 
miss the fact that software is a multiplier of hardware, 
they do not appreciate why so much time and money must be 
spent on the software if the hardware is to do anvthina 
worthwhile. 

It is important to realize that the instructional skills/ 
knowledge to be amplified can take many forms. The content 
of the training materials must be relevant, accurate, and 
complete. When the instruction is in self-study form, it 
is critical that it include manv exftmoles, evaluation 
activities, and be interest!:. -« . The design of effective 
self-study materials requires considerable instructional 
design skill. Furthermore, the traininq materials must take 
advantage of the unique characteristics of the media involved. 
When managina a trainino course involvino self-study materials, 
the instructor must be able to tutor students when they have 
problems and motivate students to comDlete the course. In 
other words, there are a wide range of instructional skills 
and knowledge that must underly any use of instructional 



technology. We will elaborate on this expertise needed in 

m 

Chapter IV. 

«• 

The equation above does not address some of the other important 
aspects of making instructional technology work. For example, 
instructional technology is an innovation and hence involves 
the process of social and organizational change. Successful 
implementation of technology requires a great deal of deliberate 
political engineering to change existing policies, procedures, 
and roles. Another important aspect of makino technology work 
is good administration and management. As in most other domains 
of human endeavor, instructional technology orojects are successful 
because of careful and systematic planning and supervision. 



o 

ERIC 



The history of instructional technology provides amole data 
on these points (e.g., Cuban, 1986; House, 1974; Saettler, 1968). 
During this century, there has been a succession of new 
technologies that promised to "revolutionize" education and 
training: film, radio, television, teaching machines, 
programmed instruction, computer based instruction, interactive 
videodisc, teleconferencing, etc. While each technolooy has 
been used effectively, none has produced the kind of revolution 
that was heralded. This is because most practitioners (including 
instructors and trainina administrators) have a very superficial 
(technolooy ■ hardware) understanding of instructional technology. 
One finds that the projects where technology has been applied 
successfully consist of people who have a sophisticated view of 
technology — a view that includes these tenets: (1) the central 
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role of instructors in wanting to use and knowing how to use a 
technology, (2) the importance of doing a good jot on the software, 
and (3) the necessity of qettina everyone involved including the 
employees who will use the training, their managers, and the 
senior executives of the organization. 

Cost-Effectiveness 

Cost-effectiveness evaluations of technology-based training 
approaches often reflect the simplistic view of technoloay as 
hardware. The most common form of evaluation is the comparative 
study between a course tauaht via classroom instruction (the 
"conventional" method) and the same course tauaht via technoloay. 
The bia problem here is that to really make an appropriate 
comparison, you may need to change the teaching strategy and the 
content as well as the media. If you do this, the two courses 
are not likely to teach the same thina and so the comparison 
is faulty. Hence many such comparisons have an inherent Catch-22. 

Furthermore, such comparative studies are based on the idea that 
there is a simple dicotomy between classroom instruction and 
self-study instruction involving technology. In fact, there are 
many variations involvina the use of technoloay in the classroom 
by the instructor as well as group activities associated with 
self-study courses, in a ;ypical trainina course, there will be 
many types of instructional activities, some of which will be 
more suited to the use of technoloay and some which will be more 
appropriate to lectures or discussions. Comparative studies that 
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examine a single module of a course usinq a stereotyped distinction 
between classroom lecture and technoloay-based instruction are 
not likely to reveal anything of significance. 

These fundamental problems aside , there have thousands of such 
comparison studies conducted, especially for CBT and 
interactive videodisc. Orlansky & strina at the Institute for 
Defense Analysis have summarized hundreds of studies of CBT, 
flight simulators, and maintenance simulators conducted in the 
military (see Orlansky, 1986) and shown that as far as military 
training is concerned, technolooy can save time and result in 
better achievement. Fletcher (1989) summarized the results of 
31 studies of interactive videodisc training (15 military; 
3 industrial; 13 higher education) and concluded that interactive 
videodisc was more effective than conventional instructional in 
almost all cases (the averaae effect size was 0.51). Fletcher 
observes that the more interactive features used, the more 
effective the videodisc training appeared to be. DeBloois (1988) 
also provides a cost-effectiveness analysis of interactive 
videodisc and reaches the same conclusions as Fletcher. 

Table 1 summarizes some of the potential benefits that can 
result from the use of any type of instructional technology. 
The qualification "potential" is important because none of 
these benefits will automatically occur through the use 
of technology, in order to realize any of the benefits 
listed in Table 1, the correct combination of instructional 
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Table 1 



POTENTIAL BENEFITS OP INSTRUCTIONAL TECHNOLOGY 

1. Reduced learninq time - typically 30-40% less time is required 

compared to classroom instruction. 

2. On-demand training - instruction is available when and where the 

employee needs it. No need to wait for/travel to a scheduled 
class. Increases access to traininq for the disabled. 

3. Increased motivation - students usually report that they find 

technoloqy-based training more interestinq and enjoyable 
than classroom lectures. 

4. increased achievement - when corrective feedback or a masterv 

learning strateoy is Drovided, students often show oetter 
test results, retention, or job performance from 
technoloqy-based traininq. 

5. Better quality control - since traininq is delivered in the 

same way each time, it can be much more consistent and 
reliable than classroom instruction. 

6. Increased safety - employees can learn about and practice 

danoerous orocedures without a safety concern. 

7. Greater flexibility - fluctuations in number of trainees or 

their backorounds can be accommodated more easily than 
with classroom instruction. 

8. imoroved accountability - automatic collection of data on 

student oerformance can verify traininq accomplished 
and identify traininq problems. 

9. Paster revision - to the extent that the instruction is 

delivered via a networked system, chances and updates 
to information can be made immediately. 

10. Reduced delivery costs - once developed, technoloqy-based 

traininq is likely to cost less relative to labor 
intensive classroom instruction. Also can be used 
instead of expensive equipment. 



skills, hardware and software is necessary as explained 
in the previous section. 

One of the most robust findings reoardinq the cost-effectiveness 
of technology-based instruction is that trainina duration is 
reduced 30-40% relative to the classroom. This result seems to 
occur because most people can learn faster by themselves than 
the slower pace set in a class. It also appears that the desiqn 
of course materials for technoloay-based approaches is typically 
better and results in faster learning. A 30-40% reduction in 
trainina time can be translated into substantial cost savinas 
in terms of reduced time away from the job or producing results 
sooner in a job. Alternatively, orqanizations take advantage of 
the time reduction by teaching more in the same training duration. 

Note that the time savings outcome is not especially important 
in higher education where there is no incentive to aet students 
through trainina as soon as possible. In academic settinas, only 
improved achievement counts (if anvthino does). While the evidence 
suggests that technoloay-based aporoaches can result in improved 
achievement, it .s a more variable effect than time savings. As 
already discussed, effective use of technoloay depends upon the 
skills of the instructor and the software involved. These are the 
two factors that most often account for the variablity that results 
in achievement outcomes. 
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The ultimate irony about cost-effectiveness studies of instructional 
technology is that they probably make very little difference in the 
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adoption of technology in many trainina settings. Decisions to adopt 
technology are typically made on non-rational grounds. In my 
experience one of the most common reasons for using technoloay is 
to allow an individual or organization to give the appearance of 
being at the forefront or "leading edge" of things. Managers 
freguently do not care if the technology actually works (hence 
the lack of interest in evaluation) as long as it gets used and 
attracts positive attention to them or their organizations. We 
could call this the "peacock" basis for using technology. 

An even more comoellino reason to use technoloay is simple 
convenience. When it becomes administratively easier to provide 
instruction via technology relative to classroom instruction, 
it becomes the training method of choice (regardless of 
effectiveness). We see this haooening in many large companies 
now for Computer Based Training. Since most employees have a 
terminal on their desk, it is easier and less expensive to 
provide training via the tube than require employees to go 
to classes. The quality of the training may or may not be as 
good as in the classroom but it is the most convenient 
alternative. Indeed, convenience is undoubtedly one of the 
key ingredients of a successful technology. 

Summary 

Instructional technology is often eguat ed solelv with hardware 
neglecting the importance of instructional skills and software. 
Historically this misunderstanding has limited the effective 
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use of technology in training. Some technologies such as 
computer -based training, interactive videodisc, and simulators 
have been evaluated extensively with the results showing that 
they can be highly effective. The most common benefit of usina 
technology is to reduce the trainina duration by 30-40% relative 
to classroom instruction. Experience indicates that rational 
considerations such as cost-effectiveness are not usually the 
primary factors in makina decisons about the use of technology 
in training. Instead, technology is often used because it 
creates visibility or simplv because it is convenient. 
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II. INSTRUCTIONAL TECHNOLOGY IN THE WORKPLACE: THE PRESENT 



In this section of the report an attempt is made to chronicle 
the current use of instructional technology in the workplace. 
After some qeneral remarks about the extent and nature of usaae, 
a number of different technologies are discussed alona with 
case studies that illustrate specific applications. Background 
readinq about the technologies discussed in this section can 
be found in Gaane (1986), Gayeski & Williams (1985), Johnston 
(1987), Niemi & Cooler (1987), Schwier (1987), and Kearslev 
(1984a). Appendix A provides a more detailed analysis ot 
current military applications. 



Extent of Use 

It is difficult to get solid data on the extent to which 
instructional technology is being used in industry for a number 
of reasons. In most large corporations, decisions to use 
technology for trainina are often made on a departmental basis 
and hence there is no organizat ion-wide accountability. Many 
applications of technoloay are considered experimental and 
hence not included in descriptions of operational training 
activities. At the other end of the extreme, some technolooies 
(e.g., overheads, video) are so common that nobodv bothers 
to count their use. In general, most oraanizat ions do not have 
very extensive data about their training activities <e.a., how 
many students they teach, how manv classes, etc.) unless this 
data is required by qovernment regulations. 
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While instructional technology of one form or another may be 
common in larqe organizations, it is relatively non-existent 
in small businesses. Actually, formal training of any type is 
absent in moat small businesses. Small businesses tend to 
rely on on-the-job apprenticeship for employee training. To 
the extent that any training materials are used, it is likely 
to be the printed documentation provided by vendors with 
equipment. There may be some use of CBT courses on personal 
computers to learn computer-related topics (e.g., a specific 
word processor) and video cassettes for sales, customer service 
or management skills since personal comouters and VCRs are 
relatively common even in small companies. 



The one exception to the lack of formal training in small 
businesses comes at companies that are franchises. In this 
situation, the parent organization can afford to develop 
materials that are distributed to each franchise. Fast food 
companies such as Dominos Pizza, FoodMaker, and Southland 
Corp (7-Eleven) make extensive use of video and are 
exper imcntina with interactive videodisc to train basic 
employee skills at the work site (see Domino's case 
study in Chapter V). To the extent that manv small 
businesses are franchises, this mav be one of the major 
ways that instructional technoloay affects small business. 



Instructional technoloay is probably more prevalent in military 
training than the civilian sector. Certainly, the Department of 
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THE BUSINESS DISC ( TBD ) : 
INSTRUCTIONAL TECHNOLOGY FOR SMALL BUSINE3S 



To date, instructional technology has had relatively little 
impact on small businesses since they tend to do little 
formal training and spend little on training materials. One 
way that instructional technology can impact small businesses 
is when it is used by the various government and professional 
organizations that small businesses interact with. 

An example of such a program is The Business Disc (TBD), an 
interactive videodisc developed by the Maryland State Dept. 
of Education. The program provides an introduction to the 
factors involved in starting and operating a business such 
as type of ownership, location, salaries, capital investment, 
and cash flow. The program includes a simulation of the first 
year in business based upon decisions made in the planning 
stage by the user. Typical business issues are presented: 
rent increases, personnel policies, late deliveries, theft, 
and disgruntled customers. The workbook accompanying the 
disc provides a full range of advisory services (e.g., legal, 
insurance, real estate) and record-keeping forms for business 
planning. 

The TBD program has been used at small business development 
centers and community colleges across the country. For example, 
New York state has decided to implement IVD workstations in 
21 small business centers in order to make TBD program 
available. The program helps prospective business owners 
analysis their business idea and develop a business plan. 
At the community college level, the program is being used 
in business and marketing courses to allow students to try 
out business ideas they learn in classes. 

People and students who have tried the program are very 
enthusiastic about it. The simulation allows the user to 
investigate their business ideas in a realistic setting. 
Even experienced business owners report that they learned 
things from the program. 



Source: R. France. Experimenting in business with IVD: An 
evaluation. Instruction Delivery Systems, Sept/Oct 1989. 



Defense conducts more research in instructional technology than 
private industry (e.a., see Ellis, 1986; Seidel & Weddle, 1987*. 
The hiqh interest in instructional technology from the military 
Is due to a number of reasons: (i) it is a technologv-based 
culture, (ii) there is an acute need for cost-effective training, 
and (iii) they can afford the high start-up costs associated 
with hardware and software/courseware develooment . There are 
many examples of large training programs using technology 
in the U.S. military ranging from interactive videodisc to 
simulators (see the EIDS JSEP and SIMNET case studies later 
in this report). Still, the overall bulk of military trainina 
today is still conducted by classroom instruction or on-the-lob 
apprenticeshiD unaided bv any form of instructional technology. 



Why is No-Tech So C ompe lling? 

Before surveyina the various tvpes of instructional technoloav 
in use, it is worth soendino a little time examinina whv so much 
teaching uses no technolooy at all (beyond a blackboard/f lipchart 
or the actual equipment). This auestion is fundamental to 
understanding the preconditions for the use of technoloav in 
training . 



In order to use any form of technolooy in training, the instructor 
must be familar and comfortable with such technoloav. However, most 
instructors (like their students) have had verv little exoosure to 
technology in the classroom; thev teach as thev were tauaht. Even 
instructors who have had one or two courses about instructional 
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technploqy do not usually have sufficient "hands-on" experience 
to confidently use it themselves in the classroom or design such 
programs. So, we have a self -perpetuating cvcle of non-technology 
use that is hard to break out of. 

The second reason why technology is not used is that it reouires 
a significant amount of preparation time and develooment effort. 
Most instructors do not have the time (or are too lazy) to prepare 
the necessarv courseware. For examole, consider the amount of 
time reguired to develop a set of good guality overheads comDared 
to writing out a set of notes. The former must be done at least 
a few days before in order to allow time for the transparencies to 
be made; the latter can be done an hour before the class. Futhermore, 
considerable thought must be out into the visual layout of the 
overheads which is not necessary for Dersonal notes. When we move 
up to more sophisticated media such as video, computers, or 
teleconferencing, the amount of Dreoaration and olannina involved 
goes up appreciably. 

Another asoect of develoDina technoloav-based trainina materials is 
that they often reguire a team aDDroach. However, teachino has 
traditionally been a solitary affair. Indeed manv instructors are 
attracted to this Drofession because thev like to work alone and 
tend to be very independent. However, the develooment of a video 
or computer -based instruction orooram is likelv to reguire the 
collaboration of two or more DeoDle with different kinds of 
technical skills. While it is true that some individuals can 
complete the entire production cvcle of a video or comouter 
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program themselves, this takes a considerable breadth of skill 
and knowledae about instructional technoloqy. 

Finally, it must be Dointed out that a laroe percentaae of the 
people involved in trainina have no formal backaround or 
preoaration in instruction. It is common for peoole to be 
placed in traininq roles because of their content expertise, 
because they excelled at their jobs, or because thev do not 
fit anywhere else in the orqanization . Because they lack anv 
forma* preparation to teach, thev have no conceotion of the 
various instructional methods or media that can be emoloved. 

It is important to realize that even when well-designed 
self-study materials are available, instructors and traininq 
managers play a critical role in the successful use of these 
materials. If thev do not understand the media involved, if 
they cannot modify the materials, and if they cannot DarticiDate 
in the develoDment of new materials, thev are not aoino to 
use instructional technoloqy well or at all. One of the endurino 
myths of the instructional technoloqy field is that once the 
training is "oackaoed" in some form of self-study course, there 
is no siqnificant need for instructors. Nothing could be further 
from the truth. 

t 

To summarize, the no-tech apDroach to traininq persists because 
most instructors do not have enouah experience usinq technoloav 
in the classroom to try it, because they do not or will not take 



the time necesaarv to prepare technology- based learning materials, 
and because many instructors are profoundly ianorant of even 
the most basic teaching techniaues. Until wave are found to 
circumvent these considerations, instructional technology is 
likely to remain in the background at most oraanizat ions . 

Why Lo-Tech is So Successful 

Despite the somewhat bleak picture of technology use Dainted 
in the preceding section, there are some technoloaies that are 
widely used in tramina, namelv orint and overhead transDarencies . 
Almost everv training course uses orint materials in some form 
and most classrooms have an overhead orolector. Let's look at 
these two technologies in detail to find out what makes them so 
successful . 

As a technolooy, print has been around for a lona time (at least 
4 centuries). Printed materials are familar to everyone, almost 
everyone (in developed countries) can read, and there is a well 
developed infrastructure for the oublishing business. Printed 
materials are hiahly reliable, thev are relatively inexoensive 
to develop and reproduce, and thev are verv convenient (i.e., 
portable, comoact ) . Almost any kind^of subject matter can be 
presented via orint and there are vast amounts of material 
already available in Drinted form- 
Given these characteristics, it is no wonder that Drint is the 
main medium for instruction. In fact one puzzles over why we 
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should need anythinq else. There are a few limitations: (i) 
when the amount of information to be learned becomes extensive, 
printed media become verv bulkv and difficult to search throuah, 
(ii) print is incapable of oresentina information in dynamic 
or interactive form, fill) it takes time to physically distribute 
printed media. Unless the instructional circumstances involve 
one of these limitations, there seems to be little reason to 
qo beyond printed materials. Indeed, this has been the case. 



Overhead transparencies are widely used in the trainina world 
(much less so in hiaher education). The Prime rationale for 
their use seems to be to present more information in a shorter 
time. In essence, thev are a labor-savino device for instructors 
since they save them the trouble of havina to write the same 
thinas on the blackboard each time they teach. Thev allow color 
to be used, as well as the oresentation of illustrations, 
photoaraphs, or araohics. They also allow the flexibility to 
use orepared materials or create on the spot. Overhead projectors 
are fairly reliable (exceDt for bulbs burnina out), affordable, 
and standardized. They do not require any training to operate 
and the skills involved in developing good overheads are easy 
to learn (e.g., use larae print). 
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It is helpful to summarize the attributes of Drint and overhead 
transparencies that make them successful as instructional 
technoloaies: (1) af f ordabi 1 i tv, 12) reliability, (3) flexibility, 
(4) standardization, and (5) ease of use. Technolooies that lack 
these characteristics are not likely to be widelv adopted and 
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SIMNET - Networked Simulators 
Filling a Gap in Military Traininq 

In military trainina, one endurina problem is providing enouah 
hands-on practice in the operation and repair of eauioment — 
including weapons, support vehicles, telecommunications gear, 
and loqistics hardware. In many cases, it is simply too risky, 
too expensive or not physicallv possible to use the actual 
equipment for traininq. Conseauently, the military has been 
a biq advocate of usinq simulators as much as possible. 

Even with simulators, there has always been a weak spot in 
hands-on traininq — team skills and oroup coordination. To be 
effective on and off the battlefield, soldiers must be able to 
function as a unit. Conventional simulators only train hands-on 
skills at the individual or crew level. The adve.it of SIMNET 
changes this situation. 

SIMNET is a research project initiated by ARPA to develoo 
networked simulators, i.e., traininq devices that can talk to 
each other via local and remote networks. This allows trainees 
to respond to the behavior o* other peoole in the network, not 
just their own actions. SIMNdT provides a wav for the military 
to train teamwork and qrouo interaction skills in realistic 
battlefield circumstances. 

The SIMNET effort presently consists of a network of 240 
simulators at 11 sites (7 in the U.S.; 4 in Europe). Equipment 
currently simulated includes Ml tanks, M2/3 Bradlevs, fiohter 
aircraft, helicopters, command/fire control elements, and 
a battalion operation center. In princiDle, any of these sites 
can "fight" any other site via the network. Preliminary data 
from the use of SIMNET indicates that it siqnif icantlv improves 
the performance of soldiers in actual field exercises! 

SIMNET pushes the state-of-the-art in a number of technoloqies 
including computer animation and 3D araphics as well as packet- 
switched networks. It also presents new trainina ooportuni ties 
such as "replaying" the recorded performance of a unit to analire 
mistakes or to reoeat a combat exercise until trainina objectives 
are met. In addition, it opens uo the possibility of "what-if" 
experimentation in combat situations — somethina not really 
possible in actual field exercises. 

SIMNET is likelv to have major reoercuss ions on the nature of 
future trainino in the militarv. Will it have anv influence 
on civilian trainina? Clearlv, there are some occupations such 
as emeraency services that involve the same eauipment-related 
teamwork situations. It is oossible to imaaine the use of 
interactive video sequences that depict all kinds of inter- 
personal scenarios rather than just eauipment operation. This 
9 would make networked simulation applicable to "soft skills" 
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traininq such as manaqement, suoervision, and customer service. 
On the other hand real-time interaction via videoconferencina 
may be a better alternative. While it is not clear what the 
ramifications of SIMNET miaht be to civilian traininq at this 
point, it is bound to have some impact. Team skills and arouo 
coordination are just as i moor t ant in industrial traininq as 
military instruction. 
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used. Many of the techneloqies to be considered in the following 
sections fail on one or more of these factors. 

Broadcast Television 

Considering the widespread acceotance of television as an 
entertainment medium, it would seem natural to exoect it to be 
equally well used for instructional applications . This is not 
the case. Despite manv attempts, broadcast television has never 
taken root in the trainina world. There appear to be many reasons 
for this lack of acceotance: (i) hiah production costs/time 
associated with television prooramming, (ii) costs of the 
receiving equipment includinq monitors in classrooms, (iii) the 
lack of involvement of local instructors, (iv) lack of flexibility 
in schedulino, (v) student boredom due to lack of interaction, 
and (vi) regulations concernino the use of television frequencies. 

The use of satellites is chanqina the situation for television 
based training significantly. Satellites make it Dossible to 
deliver television Droorams directlv to comoanv sites without 
the need to involve cable companies or television stations. 
In addition, satellites can be used for teleconferences employing 
2-way video which addresses the interactivity problem (although 
most teleconferencing uses 2-wav audio as a more cost-effective 
approach ) . 



Many larce organizations have satellite uplink/downlink facilities 
at branches or plants and use television to broadcast training 
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NATIONAL TECHNOLOGICAL UNIVERSITY: 
A SUCCESSFUL INDUSTRY -ACADEMIC ENTERPRISE 



The National Technology University (NTU) uses satellite to 
broadcast programs originating at universities to corporate 
sponsors. There are 24 member universities and 49 corporations 
involved (plus 5 federal agencies) with a total of about 200 
receiving sites. In 1989, approximately 450 graduate courses 
were offered along with many additional short (continuing 
education) courses. NTU estimates that more than 4,000 people 
have enrolled in graduate courses since they ware first 
offered in 1984 and that a total of 30,000 people are 
currently taking short courses. NTU averages over 250 hours 
of live broadcasting weekly — more live programming than 
ABC, NBC, and CBS combined. 

NTU graduate courses focus on engineering and computer science 
and they are tauoht by faculty members in the Enoineering 
departments of the member universities. Even though a student 
takes courses that originate from different universities, the 
degree (MSc)is granted by NTU. NTU is accredited by the same 
body that certifies other universities. Corporate sponsors pay 
some form of site fees to receive the programs in addition to 
providing their own downlink and classroom capabilities. 

NTU hosts many teleconferences (1 way video/2-way audio) as 
special programs for continuing education. The topics of 
these teleconferences tend to be leading edge areas in 
engineering and technology such as superconductors, super 
computers, distributed networks, automated manufacturing, etc. 
Such teleconferences allow engineers and their managers to 
stay abreast of the latest developments without havina to 
leave their offices. The teleconferences add an interactive 
component to the broadcasts that allow participants to 
ask questions and share experiences, making the courses 
more Interesting and personally relevant. 

In general, students seem to be content with the quality of 
NTU courses. The currentness of the courses and the expertise 
of the instructors (who are often the leading experts in their 
field) are the most liked features of NTU courses. Although 
it is not freely admitted, most of the programs are dull and 
boring being strictly of the "talking head" variety. Some of 
the camera and transmitting equipment at the universities 
has been substandard resulting in ooor picture quality. 
However, NTU has encouraged the universities involved to 
upgrade their equipment and many have done so. 

Enrollment in NTU courses continues to increase yearly and by 
this measure it is a success. It meets the needs of continuing 
education for engineers in a cost-effective and convenient 
fashion for the organizations involved. Perhaps NTU will 
serve as a model for professional education in other areas 
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such as medicine, law and finance. 
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courses. The National Technolooical University ( NTU) broadcasts 
hundreds of enaineer incr courses to coroorations and federal 
agencies (see case study). However, few organizations have 
addressed any of the Droblems mentioned above that have prevented 
television from becomino a successful instructional technology. 
For this reason, it seems unlikely that broadcast television 
will become widely adopted or used in the trainina domain. 
It may fare better as a comDonent of teleconf erencina (discussed 
later) . 

Video/Videodisc 

Video (and its precursor, 35mm film) has had a lona aestation 
period as an instructional technology. Prior to the emeroence 
of inexpensive 1/2 inch VCRs and the VHS standard, video was used 
only infrequently in coroorate training, typically for SDecial 
training situations such as behavior modelino or safety trainina. 
The need for expensive and often unreliable players deterred 
most instructors from using it in the classroom. 

With the widespread commercial success of VHS VCRs. videotaDe 
has become a much more familar medium to most Deoole includina 
instructors. The plavers are inexpensive and hiahlv reliable. 
Most trainina centers (including those at plants and branch 
offices) have a VCR and monitor. There is a larae selection 
of commercially available proarams coverina most areas of 
training. For example, the American Management Association (AMA) 
and the American Media Center for Engineer ina Education (AMCEE) 
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have larqe libraries of taoes for trainino. Professional societies 
such as the IEEE orovide self-studv courses based on videotapes 
for continuino education of their members. Most larae comoanies 
and government aaencies produce an expensive number of instructional 
tapes for use within their oroanization. Because so many people in 
the U.S. have VCRs at home, video is also a viable medium for 
self-siudy instruction as well as classroom use. 

Data from the 1989 annual trainino survey conducted bv Tramina 
maaazine indicates that video is now used bv almost 90 percent 
of all laroe corporations for some tvoe of trainino. However, 
despite its wide usaae, there are still some limitations to 
video as an instructional medium includina: (i) substantial 
development time/cost reauired, (ii) unsuitabilitv for presentinq 
a lot of factual information, fiii) lack of customization bv 
an instructor, and fiv) lack of interaction between the student 
and the material. Puttino the video in videodisc format helps 
somewhat because a lot of text or oraohic information (and 
possibly audio) can be added as still frames, the contents of 
the disc can now be randomly accessed, and branchina can be 
added to make the oroarara interactive fi.e., responsive to the 
responses made by the student;. However, videodisc adds more 
development time/cost and reouires a videodisc plaver plus a 
personal computer if it is interactive. 

Many organizations seem to feel that the additional cost and 
equipment required for interactive videodisc is well worth the 
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effort. For examole, GM is usino interactive videodisc extensively- 
throuqhout the oraanization for technical and sales trainina. 
In conjunction with the UAW, it has established a Center for 
Health & Safetv that offers dozens of self-studv courses usino 
interactive videodisc materials. Accordina to industry fioures, 
GM alone has bouaht over 10.000 videodisc Dlavers for use in 
trainina. Ford and Chrvsler are also usino interactive videodisc 
extensively for trainina. Various branches of the Deoartraent 
of Defense have made major committments to interactive 
videodisc for trainina. For examDle, the Armv EIDS prolect 
expects to ultimatelv field 50,000 Dlavers for use in schools 
and unit trainina (see BIDS case studv) . 
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There are a number of aoolication areas where interactive video 
appears to have unioue instructional value. It has been used 
extensivelv in the desian of simulations for maintenance trainina. 
For examole, Federal Exoress develooed a videodisc based course 
to teach their aircraft mechanics how to troubleshoot and reoair 
electrical problems. The proaram allows mechanics to take readinas, 
test components, replace eauioment, and evaluate procedures. 
Interactive videodisc is also beina used extensively to improve 
basic skills and literacy, takinq advantaoe of the visual and 
motivatino characteristics of the medium. For examDle, IBM 
developed and markets PALS (Princioals of Alphabet Literacv 
System), an interactive video svstem emolovina a touch screen. 
PALS is used to imDrove readina skills in manv schools and 
orqanizat ions . The Reynolds Tobacco Co. in collaboration with 
Forsyth Technical Colleoe in Winston-Salem, has been usino the 
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An Army Wide Interactive Videodisc Systems 
Electronic Information Delvery System (EIDS) 

In the early 1980' s, the Army was shopping for a multimedia 
delivery system to replace the slide-tape unit that had been 
in use for many years. In 1983, it asked a number of companies 
to develop interactive videodisc prototypes to evaluate as 
a potential alternative. After a number of years of field 
testing the idea, a specification for the Army Electronic 
Information Delivery System (EZDS) was established in 1986 and 
in December of that year, a contract was awarded to Matrox 
Electronics of Canada to supply the hardware and software. 
The initial contract called for a total purchase of 48,000 
units over four years with a value of 5223 million dollars. 

The EIDS workstation consists of a IBM PC/AT type computer 
employing EGA/ VGA qraphics and a 12 inch optical laserdisc 
player. The workstation is capable of overlaying graphics 
on video disDlays, playing over 1 minute of sound per 
still frame, and storing/readinq computer proorams on 
the videodisc (so-called Level IV capability). In its most 
basic configuration, the unit has a commercial price of 
about $6000. 

Actual delivery and courseware development for the system 
has lagged behind the planned development due to procurement 
difficulties. By 1989, approximately 10,000 units had been 
delivered to Army TRADOC schools and Army and Navy Reserve 
sites. In 1988, 14 solicitations to develop courses were 
authorized but many of these were not awarded due to lack 
of funds. 

One of the strengths of EIDS effort is that a number of 
authoring systems are available for the system. The primary 
authoring system, ASSIST, was developed by Computer Sciences 
Corp. for the Army and is provided to contractors to use in 
courseware development. However, at least 10 other commercially 
available authoring systems can also be used to create EIDS 
courses. This is made possible by the choice of a standard 
MS-DOS computer and laser optical videodisc player. A number 
of companies have already developed "generic* courseware 
that can be run on EIDS and there are a larae number of vendors 
capable of developing custom courseware tor the military or 
civilian clients. 

Indeed, it has been estimated that the development of EIDS 
courseware could be a billion dollar business opportunity for the 
interactive videodisc industry. How much courseware actually gets 
developed will depend upon the acceotance of EIDS within the Army 
training system and the amount of funding that is allocated for 
EIDS programs. Without specific technology transfer initiatives, it 
is unlikely that EIDS will be used for many civilian applications, 
unless one or more large companies decide to champion this system. 
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The choice of Matrox Electronics to manufacture and market the 
£ZDS system has not helped since the company is practically unknown 
in the U.S. and has made little attempt to market the system outside 
of military circles. Furthermore, the anticipated cost reductions 
of the system due to larae-scale production has never materialized. 
Indeed , the EIDS system is more expensive that comparable systems - 
available from other vendors or assembled from off-the-shelf 
components . 
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PALS system to imorove the readino skills of hundreds of 
employees since 1987. 



Another interestina use of interactive video is its use on 
the factorv floor to suoDort Comoutet Intearated Manuf actur ino 
(CIM) activities. Henrv (1989) describes two hiah tech plants 
(Apple Computer and Martin-Marietta) that Drovide workers with 
personal computer workstations capable of disolavina brief video 
sequences about different manuf actur ino Drocesses. These seauences 
can Drovide "just in time" training to correspond to the comolex 
nature of a CIM operation that involves freouent shifting from 
one operation to another. What is interestina about this use 
of videodisc is that it involves simple linear video sequences 
rather than elaborate branchino or simulation. The video is 
beino used as a visual job aid to help workers remember the 
details of different assembly line tasks. 



Evaluation studies conducted on interactive videodisc oroiects 
aive the clear-cut impression that it is a hiahlv effective 
teachina medium (see "A Powerful Multimedia Tool"). But will it 
be adopted on a widesDread basis? According to data from the 
1989 Training magazine survey, about 24 percent of larae 
corporations are currently using some form of interactive video 
trainina (but onlv about 11 percent for all comoanies with 100 
or more employees). Puttina aside the substantial develooment 
costs involved, the cost of a sinole interactive videodisc 
student station f including Dlaver, monitor and Dersonal computer) 



INTERACTIVE VIDEODISC: A POWERFUL MULTIMEDIA TRAINING TOOL 



Although its use has arovm slowly, interactive videodisc is becoming 
an increasingly common training tool. Evaluations (when conducted) 
seem to be uniformly positive. Here are some examples: 

# 

* Goodyear Tire & Rubber - compared a videodisc-based traininq 
program for mechanics in the use of an oscilloscope and 
multimeter with the same training via videotape or instructor 

led. In actual job performance tests after training, the videodisc 
approach produced the best results. Futhermore, trainees 
indicated a preference for the videodisc training. 

* McDonnell Aircraft Company in conjunction with Digital Eguipment 
Corp. developed a videodisc training program for Computer Aided 
Design (CAD). Use of the prooram cut the traininq time reguired 
for this course from 12 hours to less than 8 hours for all 
employees, decreased the cost per student hour, reduced teaching 
loads, and resulted in better retention of the material. 

* IBM conducted a research study at its Corporate Management 
Development Center comparino three different ways of using 
videodisc (instructor led, small arouDS, and individualized) 
relative to classroom instruction for an employee relations 
course. Learning gain scores and mastery levels in the 
videodisc approaches were better than classroom instruction 
that didn't use it. 

* GTE of California used interactive videodisc to train network 
technicians to troubleshoot a statewide data network. The 
videodisc-based training was superior in terms of retention 
relative to a classroom version of the course and was well 
liked by the employees. 

* The Wisconsin Foundation for Vocational Technical and Adult 
Education has develooed an interactive videodisc course called 
Interactive ModuMath designed to improve the basic math skills 
of students in Wisconsin technical colleoes. The course is 
used by a wide variety of students and is well liked by both 
students and instructors. 

* The Florida Department of Corrections has implemented a state 
wide videodisc program to train corrections and orobations 
officers on topics such as hostaqe neqotiation, surveilence 
techniques, investioat ions and emergency preDaredness . This 
program replaces the use of interactive videotapes. 

* Unisys CorD. is using interactive videodisc to train its sales 
force on the companies' Droducts and the UNIX operatino system. 
Use of the videodisc materials is exoected to save considerable 
traininq time and expenses and will be used bv the entire Unisys 
sales force of approximately 5,000 employees. 
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is between S5,000-S10,000. Even at half this price, this is not 
somethino that is affordable in auantitv bv most trainina 
organizations. Furthermore* interactive videodisc is normallv 
used for self-studv instruction while the bulk of trainino is 
still conducted in classroom format. For these reasons, it 
seems that interactive videodisc is not likelv to be widely 
adooted for trainina bv most oraanizations unless thev make 
it a special Drioritv (as GM and the Armv have done). 

Computers 

Computer Based Trainina <CBT) has been around for at least 
three decades, althouoh it was not until the emeraence of the 
personal computer in the earlv 1980's that it became a Dractical 
reality for most oroanizat ions . The availability of relatively 
inexpensive PCs made it possible for companies to trv CBT at 
a minimum cost and also cave rise to a substantial courseware 
marketplace. Ironicallv, the main thrust of CBT today is 
mainframe-based systems at laroe insurance conmanies and banks 
(see "A Good Fit for C8T H case study). There is also a substantial 
use of PC-ba.sed CBT (often involvino interactive video) for 
technical trainina (see "Usina CBT To Teach Technical Skills" 
case study) . 

A study bv Hirschbuhl (1988) oresents some data about the extent 
of CBT use in industry. In 1986, 32% of all oraanizations with 
more than 100 emoloyees and 54% of the FORTUNE 500 conmanies 
were usina some form of CBT . Bv 1987, 75% of all corporations 




A GOOD FIT FOR COMPUTER -BASED TRAINING: 
THE INSURANCE INDUSTRY 



Even though Computer-Based Traininq (CBT) is used in all types 
of companies, it has been adopted most widely in the insurance 
industry. There are several reasons for its success in this 
domain: (1) insurance companies are heavily computerized with 
almost every employee having a terminal, (2) the nature of the 
material to be learned (policy information and procedures) is 
well-suited to tutorial strategies, and (3) insurance companies 
have a strong training tradition. Since the hardware is already 
in place, the usual barrier to larae-scale use of CBT (i.e., the 
cost of buying lots of computers) is absent. 

CBT is attractive to insurance comoanies for the usual reasons: 
(1) employees can take their training in their office when 
they need it, without having to wait for a scheduled class, (2) 
it works - guest ions and practice exercises built into the 
courses ensure that employees really learn the material, and 
(3) i . saves trainina time relative to classroom instruction. 
Of thit three benefits, the fi?:st is probably the most critical 
from an employee acceptance perspective; employees like CBT 
because it is makes learning convenient. 

A large insurance company in the metropolitan Washinaton area 
serve* as an example. The company first got started with CBT 
in 1981 with an intr oductuction to claims processing course. 
However, this first attempt didn't work out because the system 
used wasn't reliable enough. Another course was tried a few 
years later on a stable system. .. this course is still in use 
today. Today the system delivers about 20 courses with about 
5 new courses being added per year. Thousands of employees take 
courses from the system. 

While CBT provides effective trainina in this company, there 
is an ongoing problem developing and maintaining good guality 
courses. They find it hard to find authors/desianers who 
know how to develop good CBT and can work with the particular 
system in use. One part of the comoany relies solely on CBT 
courses purchased from vendors (althouqh they still customize 
these courses). Buying commercial courses reduces the costs 
of courseware development but only applies to generic course 
topics (such as data processing or customer service). 

The insurance industry has tried to encouraoe courseware sharino 
through the Society for Insurance Training & Education (SITE). 
A catalog of courseware was published in 1987 and a new version 
is currently beina prepared. However, this effort has not been 
very successful to date because of i) system incompatibilities, 
ii) conf identialitv, iii ooor guality of courses, and iv) lack 
of customization capability. The industry hopes that vendors 
will start to market more generic courses of interest as well 
as providing customization services. 



Usinq Computer -Based Trainina To Teach Technical Skills 

One of the most effective areas where Computer Based Trainina (CBT) 
can be applied is technical skills instruction. The followina 
examples illustrate the scope and variety of this ©articular 
use of CBT: 

* Anheiser-Busch in St. Louis is usinq a MicroTICCIT svstem to 
teach assembly line workers how to prooerly run beer can packaging 
machines. The use of CBT is driven bv a desire to improve Quality 
control in manuf actur inq and an overall modernization effort in 
plants. The particular trainina task was oicked because it is one 
of the most critical aspects of beer packacina. 

* Burlington Northern is using a MicroTICCIT svstem to teach train 
crews the rules of operation for railroads. This ©articular course 
was selected because it is n,*!ndatorv knowledae for all train crew 
personnel and classroom instruction is not verv effective. CBT 

is being used to upgrade the quality of trainino and also distribut 
it to the field. 

* The PAA has used the PLATO system to train fliaht inspection and 
maintenance specialists for almost a decade and has recently starts 
to use CBT for air traffic controller traininq as well. Courses are 
provided to about 50 sites around the country. Primarv factor in 
the use of CBT is heavy demand for training that is difficult to 
meet with traditional classroom approaches. 

* Bell Atlantic has develooed a PC-based financial sellino skills 
course for its telemarketino represent ives . The course includes 
CBT case studies that simulate the sellino process and a Lotus 

123 cash flow temolate used to calculate lease vs. ourchase options 
The company reports that the course improves the comoetence and 
confidence of reoresentatives in their sales activities. 

* The Strategic Manaaement Group ( SMG) in conjunction with the 
Port Authority of NY/NJ has develooed a PC-based course called 
"Export to Win" desioned to teach business Deople all asDects 
of exportino products to international markets. This course is 
one of a series of business simulations develooed and marketed 
by SMG. 

* Applied Learnina {formerly Deltek) offers hundreds of data 
processino courses that run under the Pheonix mainframe CBT 
system. These courses are used by thousands of oraanizat ions 
around the world to train their DP/MIS staff about mainframe 
operating systems, applications software, and telecommunications. 
In many companies, Aoplied Learninq courses serve as the 
stimulus for deveioDina their own CBT. 



surveyed had over 100 CBT stations (compared to onlv 20% in 1985). 
Host courseware was suoplied bv vendors (70%) with onlv 6% 
developed in-house. Data orocessina trainina was the most 
popular form of CBT and category of commercially available 
courseware. All comoanies surveyed indicated that thev olanned 
to use CBT more heavilv in the future. In the 1989 Trainino 
maoazine survey, about two thirds of all companies with 100 
employees or more indicated thev were usino comouters in 
trainino, with the orecentaoe increasino to 83% for laroe 
corporations with 10,000 emolovees or more. Both the Hirschbuhl 
study and the Trainino maoazine survev confirm that the use 
of CBT in laroe oroanizations has become widesoread and is 
more common, the laroer the oroanization. 



The U.S. military has been one of the major orooonents of CBT 
havinq applied it to a variety of different types of trainino. 
Past efforts are summarized in Ellis (1986) and Seidel & Weddle 
(1987). In an Auaust 1986 reoort about CBT projects in DOD 
published bv the Trainina Technolooy Transfer Prooram, a 
total of 240 Projects were identified with details available 
for 45 of these projects (16 Armv, 15 USAF. 6 Navv, 3 USMC, 
and 5 Joint). Another reoort from the same arouo showed 
368 research projects in the trainina domain involvina 30 
different DOD aaencies, 29 universities, and 70 commercial 
contractors. As this data suaaests, DOD is the major force 
in CBT R&D and is laraelv responsible tor the direction chat 
the field takes (see further discussion of this DOint in 
Chapter III and Appendix A). <| * 
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When it is necessary to buy computer workstations soecificallv 
for CBT, it becomes a relatively exoensive trainino aoproach. 
However, to the extent that computer terminals and PCs are 
already available for work functions, CBT becomes a value-added 
use of this eouipraent. Indeed. CBT becomes the most convenient 
way of deliverina trainina since it does not require the effort 
of schedulino a classroom and instructor. Provided that CBT 
courses can be develooed or ourchased for a cost that is 
comparable to classroom instruction, CBT is likelv to disDlace 
much classroom instruction in comoaries where everv emDlovee 
has a comDuter or terminal. This is whv the develoDment of 
author ino tools that reduce the cost and time to develoD CBT 
materials is such a key factor in makina this instructional 
technoloov successful on a wider scale (see ChaDter IV). 

A number of efforts have been made to aoolv CBT to basic 
skills trainino. The laraest such effort is the JSEP Droaram 
initiated by the U.S. Armv and now beina tried for vocational 
education (see JSEP case studv). Another major effort is 
beina undertaken bv McGraw-Hill in conjunction with AddI e 
Comouter. Based upon the functional literacv work of Tom 
Sticht fsuDDorted bv DOD for manv vears ) , a series of Drint 
and CBT oroorams in 6 areas fhealth, automotive, business, 
contruction trades, electronics, and office) are beina 
develooed at a cost in excess of S3 million. The Adult 
Literacv and Technoloov Droject beina coordinated bv 
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Applying CBT to Workplace Llteracys 
Tho Job Skills Education Program (JSEP) \ 

9 

One of the most extensive efforts to use computer -based training 
to improve basic skills is the JSEP program. JSEP was originally 
developed by the U.S. Army (contractors were Florida State Univ 
and Ford Aerospace) at a cost of about $11 million dollars. JSEP 
operates on both the PLATO and MicroTICCIT computer systems and 
provides more than 300 lessons (400 hours of instruction). The 
lessons were based upon an extensive analysis of the skills 
required for the 94 most common Military Occupational Specialties 
and common soldier's tasks. JSEP includes a student management 
system that keeps track of performance data such as the amount 
of time spent in each lesson, test scores, etc. The system also 
generates individual learning prescriptions for each student 
based upon pretest or other diagnostic information. 

JSEP has been field tested in the Army with thousands of soldi ars. 
Oata indicate that if soldiers are given enough time in JSEP, 
their performance on standard Army tests improves. Students indicate 
a strong preference for JSEP over conventional instruction because 
it is more interesting and provides lots of feedback. Instructors 
like it too because they can use it to give students soecific 
practice in deficient skills. The lessons were carefully designrd 
based upon the principles of instructional design and adult learning 
theory. In addition, the JSEP curriculum includes learning strategy 
modules that help the student learn how to learn (e.g., time 
management skills, test taking skills, oroblem solvina skills). 

In 1987, Florida State was awarded a contract from the U.S. Dept. 
of Education to develop a civilian version of JSEP. Many of the 
basic skills required for Army specialties transfer over to 
civilian occupations such as health care aides, accounting clerk, 
electrician, police officer, machinist, auto repair, computer 
operator, etc. Under an interagency agreement between the Dept. 
of Labor, Dept. of Education, and Dept. of Defense, JSEP is beina 
pilot tested at an adult education center in White Plains, NY 
with additional sites planned for Indiana, California and 
Delaware. The goal of the civilian version of JSEP is to provide 
basic academic skills for welfare recients, vocational education 
students and trainees eligible for JTPA programs. 

Despite the funds spent on JSEP by the Army and its apparent 
effectiveness with soldiers, the widespread implementation of the 
program is not planned at the present time. Each JSEP station 
costs several thousand dollars and full-scale deployment would 
require a large purchase of either PLATO or MicroTICCIT terminals 
to be used exclusively for JSEP. Army decision makers are not 
clear if JSEP is the best solution to basic skills training in 
the military or if the cost of such training is worth the huae 
investment that JSEP would reouire. A similar dilemma is likely 
to be faced by civilian decision makers. 
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People's Computer Co, in California involves the use of 
commercially available educational software in vocational 
educational proarams at community colleaes and other trainino 
centers. The Technoloov for Literacy Center in St. Paul. 
Minnesota, has demonstrated the success of usino comouter 
based instruction with adults in terms of continued enrollment, 
student satisfaction and increased achievement. 



Simulators 

In many types of "*obs, it is necessarv for the emDlovee to 
learn how to ooerate or maintain some oiece of eauioment sucft 
as an airdane, teleohone switch, nuclear reactor, submarine, 
or robot workcell. Ideally, the trainina involves hands-on 
practice operatino or reoairinq the eauioment. However, in 
many cases, the actual eauioment is too exDensive, too 
danaerous, or too scarce to use for trainino. instead, 
simulators (also called trainino devices) are used. 



Historically, the militarv has been the crime user cf 
simulators for aircrew and aircraft maintenance trainino. 
A series of analvses bv orlanskv & strino (summarized in 
Orlansky, 1986) showed that the use of such simulators 
for militarv trainina was hiahlv effective. For vears 
all of the major airlines have been usina fliaht simulators 
for pilot uDarade trainina with sianificant cost savinas. 
DesDite the benefits and cost-effectiveness of such 
simulators, thev are verv exoensive to develoo and run. 
For examole, a comDlex full motion flioht simulator miaht 




well cost millions of dollars. The hioh cost of simulators 
has limited their use outside of the aircraft trainino area. 



The advent of interactive videodisc and powerful PC-based 
workstations has chanoed this situation considerably, it is 
now oossible to develoo a "low fidelity" simulator for well 
under S100,000. This lower cost makes the use of simulators 
more feasible in a broader ranae of Lrainina aoplications 
includina drivina/reoair ino trucks, factory machinerv, test 
eauiDment and electrical/electronic devices. Instead of soendina 
a lot of develooraent time/monev on buildino a simulator that 
works exactly like the oriainal eauiDment. video seauences can 
be shot and used with an inexpensive PC workstation. Furthermore, 
videodisc and CBT simulations can be used as part-task trainino 
devices that reduce the amount of time needed for full-function 
s imulators . 



One new twist in the use of simulators is the capability to 
network individual simulators toaether so that team behaviors 
can be oracticed. The DOD is currently implement ina a concept 
called SIMNET which allows simulators of armored vehicles as 
well as tactical aircraft and artillerv to be connected toaether 
for realtime combat exercises (see SIMNET case studv). It is 
not clear the extent to which networked simulators will be 
relevant to civilian applications, but the comouter araohics 
and network aspects are likely to be imoortant contibutions to 
the technoloav base. 
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time. The addition of a fax machine at DarticiDatina sites allows 
for the two-wav transmission of hard-coov documents for minimal 
cost. A new technoloav that could make two-wav video more cost- 
effective and orevalent is the use of compressed video transmission 
lines fTl). Tl involves the use of a codec to digitize and comDress 
the video sionals. While the aualitv of compressed video is not 
always acceptable, it does orovide a videoconf erencina alternative 
when only two sites are involved. 

With the increasina Drevalence of Dersonal comouters, comDuter 
conferencina is also becomino more common. A number of oraanizac ions 
use comDuter conferencina as oart of distance learnina activities. 
For examDle, the International School of Information Manaaement 
in Irvine, CA offers a Masters dearee Droaram usino comouter 
conferencina to conduct seminars and for student/instructor 
interaction. Boise state Universitv has a Masters dearee Droaram 
in Instructional Technoloav that also uses comDuter conferencina 
for remote deliverv of courses. This Droaram is suDOorted bv, 
and desianed to meet the needs of, the U.S. Armv and National 
Guard. Since most larae corporations alreadv have electronic 
mail systems in Dlace, t.^e Dotential exists to use these svstems 
for trainina activities. 

Many larae coroorations have extensive satellite-delivered 
television networks that are used for trainina teleconterences . 
IBM, Motorola, and Aetna are examoles of comoanies that reaulariv 
conduct trainina via teleconferences. As an illustration, Aetna 
delivers a business writina skills course to over 1000 emdovees 
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Teleconf erenc in o 

Teleconf erencina can involve three different technoloaies : 
telephones, television, and comDuters. Audioconf erencina 
involves two-wav interaction amono a number of oarticioants 
via teleohone bridoes. Videoconf erencino involves two-wav 
interaction via televison (either full motion or slow-scan). 
Computer conferencina involves the use of electronic messaae 
svstems (orincicallv mail, conf erencino and bulletin boards) 
to exchanae information. Audioaraohics svstems orovide cwo wav 
audio and araohics transmissions, the latter via computer or 
some form of f acs imi le/diait izina device. 

All forms of teleconf erencina have been explored for trainina 
purposes. While videoconf erencina is Drobably the most preferred, 
it is too expensive for most oraanizat ions . Audioconf erencino is 
relatively inexpensive but is limited bv the iack of visual 
presentations. Similarly, computer conferencina is relatively 
inexpensive but reauires access to a computer and modem. Audio 
araohics systems are fairlv cost-effective ( thev emplov two 
phone lines) but still reauire specialized eauioment. 



The best compromise in terms of cost and aualitv of information 
transmitted seems to be teleconferences involvino one-wav video 
(i.e.. broadcast television) with two-wav audio fteleohone) links. 
This allows for the full presentation of visual information but 
allows oarticioants to ask auest>ens or make comments at anv 
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at more than 50 branches via teleconference. In a classroom, the 
course takes 2 davs? via teleconference it reduces to two 1.5 hour 
teleconferences. The DOD and federal aaencies are heavilv committed 
to the use of teleconferences for trainino. In October of 1989, 
the PTS 2000 system went into oDeration which orovides an all 
dioital network connectino almost 1 million federal emolovees 
around the nation. PTS 2000 orovides both two-wav and one-wav 
video teleconferencina caDabilitv that can be used bv anv 
aoencv simDlv bv makina a reservation (and Drovidino the 
necessarv facilities and eouioment). 

The U.S. Navv has conducted a number of Droiects involvina 
the use of teleconferencina for trainina ourooses. For 
example, in 1989 it initiated an "el ectronic schoolhouse" 
Droject at its fleet combat trainina center in Dan Neck, VA. 
The project consisted of linkina classrooms at navv bases 
in Norfolk, VA, Charleston, SC. and MavDort, PL with the 
trainina center with two-wav comoressed video delivered via 
satellite. Each classroom contains two cameras, larae monitors, 
microohones, an audio sDeaker and accomodates 30-50 students. 
Ten courses were tauoht usino teleconferencina focusma on 
"scft skills" and basic concents. Both instructors and students 
adapted to the use of teleconferencina with no oroblems and test 
scores were as oood as traditional classroom instruction (Chandler 
& Lucas, 1989 ) . 



Until recently, teleconferencina has been used bv a handful of 
oraanizations that could afford the eauiDment and could find 

ERIC 29 51 



instructors willina to trv it. With the advent of larae-scale 
diqital networks and satellite links, the use of teleconf erencino 
for training is likelv to become more commonplace. However, anv 
form of teleconf erenina involves significant oreoaration time 
and relatively comDlex looistics. This is likelv to deter manv 
trainina deoartments from usina teleconferences even if the 
delivery system is available. Increasina oressure from emDlovees 
and senior manaaement to reduce travel time and costs for trainina 
is likelv to be malor factor in forcing more trainina deoartments 
to use teleconf erencina . 

O bstacle s Limiting Near -Term Use of Te£hnoloav 

It should be clear from this survey of Dresent aDDlications that 
many forms of technoloav are beina successf ull v used in all tVDes 
of trainina situations. Indeed, given the favorable results that 
have been reDorted for most of the technologies discussed, one 
wonders whv technoloav is not used more widely in training. The 
followina obstacles inhibit such broader use: 

1. Lack of exDerience usina technoloav on the Dart of trainina 
orof essionals (including instructors, develooers, and managers) is 
orobably the single biggest Droblem. Most trainers are onlv 
familar with traditional classroom instruction and have no 
exoosure or training in the use of technology bevond overhead 
projectors . 

2. Lack of monev to buv the necessarv eauiDment, develoo the 
materials, and oreDare the courses. This is primarily a budoetina 
problem since the necessarv funds are often available as salaries 
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that need to be channeled into eouioment, facilities, and contractor 
costs. Because of the reduced trainina time, less instructor time 
to deliver courses should be needed when instructional technoloav 
is used. 

3. Lack of time to develoo and Dreoare alternative modes of 
delivery. Due to lack of olannina or adeouate staffina, there 
is insufficient time to implement and test technoloav-cased 
aoproaches. 

4. Unreliability and Door usability of technoloav. In manv cases, 
soecific systems have been too comolicated to use and too fraaile 
for ooerational settings. 

Each of these current obstacles is beina addressed bv the trainina 
community. As technoloav becomes more commonly used in schools 
and colleaes, trainina oersonnel and students become more 
familiar with it. To the extent that trainina professionals 
take araduate dearees in the instructional technoloav field 
or attend conferences, thev receive increasina exposure to 
technoloay use. There are now aDoroximatel v 200 araduate level 
instructional technoloav oroarams in the U.S. and each vear 
thev Droduce thousands of soecialists who have the necessarv 
skills to desian and implement technoloav in trainina. Almost 
all of these araduates ao directlv into industry or continue 
with their militarv careers; onlv a small Drooortion ao into 
the school svstem. As oraanizat ions absorb these technoloav 
literate trainers, the use of instructional technoloav is 
likelv to become more Drevalent. 
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More and more trainino oroanizat ions are allocatino a laroer 
proDortion of their budaet to eauioment and the develooment 
of materials. As technoloav-based trainino oenerates savinas 
due to reduced trainino time or travel, these funds can be 
soent on more technoloav. However, in aeneral. manv technoloav 
based trainino Droiects result, in better aualitv trainino and 
this simolv costs more. Senior manaoement must understand that 
more monev needs to be sDent on trainino in order to have 
better trained emolovees. Technoloov is often the vehicle for 
better trainino? hence it costs more than the status auo. 

The time reouired to develoo and imdement technoloav-based 
aooroaches will decrease as a function of increased exoerience 
on the Dart of the trainino staff. A oreat deal of time is 
wasted bv novices who don't Know what thev are doina. In addition, 
imorovements in the reliability and usabilitv of technoloav 
fsee below) will decrease the amount of wasted time. The 
emeroence and use of automated instructional develooment svstems 
(discussed Chaoter IV) will also helo to reduce the amount of 
time reouired for technoloav based trainino. 

Finally, the reliability and usabilitv of technoloav has been 
imDrovino siani f icantlv over the oast decade. Solid state 
hardware and more adeouatelv tested software are resultina in 
a aeneration of hiahlv reliable electronic svstems. The emc-hasis 
on user interface desian has Droduced software that is much 
easier for oeoole to learn and use. Incoroorat ion of artificial 



intellioence and hypertext techniaues in future software is 
likely to Increase the usability further (see discussion in 
next chaoter ) . 

To summarize, most of the obstacles that limit the near-term 
use of technoloov for trainino applications are likelv to 
dissipate over the next decade. Bv the year 2000, it is 
reasonable to exoect most medium-laroe oroanizat ions to use 
some mix of technolooies in their trainino activities. The 
use of interactive video, CBT, and teleconf erencinc should 
be as common as the use of overheads and VCRs are now. Many 
of the applications will orobablv be classroom based rather 
than individualized instruction, i.e., they will be used as 
teachino tools bv instructors to enhance lectures. Since no 
one technoloov is rioht for all tvoes of courses, it is 
reasonable to exoect a combination of technolooies to be 
used in anv aiven trainino Droaram. 

Su mmary 

While the extent of technoloov use in trainino is not clear, 
most laroe oraanizati ons are usino one or more technolooies 
in some asoect of their trainino activities. Interactive video 
and computers are freouentlv used for technical trainino and 
computer based trainino is common in the insurance and bankina 
industry. Teleconf erencina for trainino is just beoinnino to 
be used in laroe corporations, federal^ aoencies and DOD. There 
appears to be little use of technoloov in small business: indeed 



very little formal trainina is conducted bv small businesses. 

The major obstacles to the near-term use of technoloav in 
trainina are (1) lack of instructor knowledae about how to 
use technoloav, (ii) lack of monev to buv hardware or 
develoo materials, fiii) lack of time to develoo and olan 
alternative trainina aooroaches, and fiv) ooor reliability 
and usability of trainina systems. All of these obstacles 
are likely to dissioate durina this decade resultino in the 
increased use of instructional technoloav for trainina. The 
drivina force behind the increased use of instructional 
technoloav bv oraanizat ions is the need to become more 
productive and increase the aualitv of their services and 
products . 




III. INSTRUCTIONAL TECHNOLOGY IN THE WORKPLACE: THE FUTURE 

This section of the report discusses emerging trends in 
instructional technology and their likely impact on the 
training world. By its n*a*ure, such discussion is highly 
speculative since it involves guesses about future directions 
based upon present trajectories. For other views about the 
future directions of technology and training, see Cetron et 
al. (1985), Dede (1989) or IRS (1989). 

One important point to realize about this section is that it 
discusses technologies that are in the research oi prototype 
stage. While these technologies are already in existence, they 
are many years (probably decades) from operational use. This 
is the sense in which they constitute future technology. 

Perso nal Worksta t ions 

The evolution of personal computers into small portable units 
is a clearcut trend. At the same time, personal computers are 
becoming more powerful with faster processors, larger memories, 
and higher resolution graphics displays. The storage capacity 
of future PCs is likelv to be enormous based upon some form 
of optical disk (e.g., erasable CD-ROM). It is probable that 
cellular modems will be built into future PCs allowing people to 
access electronic message systems and online databases without 
the need for a phone jack. Furthermore, such workstations may 
also have television receivers built in so that they can view 



broadcast TV in addition to video still frames stored in optical 
memorv. 

By 2000 it is reasonable to exoect that most Deoole will own 

at least one oersonal comouter which they carry around like a 

notebook and use for a mvriad of Durooses includino communication, 

oettina information, shoDPina, banking, and many work-related 

functions. Of course, all of these activities can already be 

done online — the difference will be in the extent and variety 

of services available, and the number of oeoole who use them. 

Since the disolav capabilities of these machines will match or 

exceed the resolution of the best oualitv Drint (e.g., at least / 

2000 doi with infinite color range), they will be used to oublish 

electronic newsoaoers, magazines, novels, and technical journals. 



This evolution of oersonal computers has many possible implications 
for trainino. The most important outcome is that since almost 
everyone has their own workstation, it will be unnecessary to 
buy them soecificallv for trainino purposes. Buvino hardware for 
technology-based trainino should become a non-issue (except for 
outfitting electronic classrooms discussed below) . Since the 
personal workstation is capable of displaying multimedia, rivalries 
between different types of instructional technology (e.a., video, 
computers, teleconferencing) should be minimized. The Dersonal 
workstation can take the dace of what are currently separate 
technologies. Finally, since oeoole use the Dersonal workstation 
all the time, thev are comfortable with it and usina it for 
learnina does not pose a novel experience. Indeed, since ceoole 
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use their workstation for informal learnina all the time, it 
is a perfectly normal occurrence. 

Even though personal workstations will eliminate manv of the 
current problems associated with hardware, it will not aet rid 
of them all. Since there are aoino to be lots of different models 
of workstations with different capabilities, there will still be 
compatibility issues (althouah thev will seem minor relative to 
current problems). Some disolavs will look better than others, 
some machines will access/disolav thinas faster, some machines 
will sound better than others, etc. In essence, we will have the 
same functional similarities as we find with cars or airplanes 
but with different performance characteristics. 

E lect ronic Classrooms 

While the availability of personal workstations and the extensive 
use of networks (discussed below) will make self-study and distance 
learnina verv common, a lot of trainina will still be classroom 
based for reasons of social interaction. Manv future classrooms 
will be equipped with a video projection capability or laroe 
monitors and a fully confiaured PC. Instructors will use this 
equipment to show multimedia materials, to access online databases, 
participate In teleconferences, and as an electronic blackboard. 
Some classrooms will outfitted with sound-activated cameras and 
rows of monitors to be used as electronic meeting rooms for 
teleconferences . 
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We already see such electronic classrooms and meetino rooms beina 
built at some corporate trainina centers and universities. The IBM . 
Management Development Center in Armonk , NY is probably the one of 
the best examoles. An instructor's station (a PC) located at the 
front of the classroom allows the instructor to control all audio- 
visual devices in classroom includino videotaoe, videodisc, slides, 
computer disDlav, and liahts. In addition, each student has a 
keypad that allows them to respond to questions oosed bv the 
instructor. The instructor and class can immediately see a disolav 
of. t^e tabulated results of the class resDonse to a auestion. 
The kevoads allow the instructor to make the class interactive 
and assess student understandino. Control of all audiovisual 
equipment makes it easier and faster to use multimedia materials 
durinq class. 



Such facilities are more expensive to build than conventional rooms 
and the additional cost must be justif i f ed/suDPorted bv trainina 
manaoement. Furthermore, because comouter capabilities are evolvina 
so quicklv at the oresent time, the eouiDment installed in these 
classrooms becomes obsolete quicklv and will need to be replaced 
periodically. The implication for trainina oraanizac ions is that 
a laraer proportion of the budaet will need to spent on classrooms, 
both initially and on a continuina basis. 



It is interestina to note the relationship between widespread use 
and ownership of PCs bv instructors and electronic classrooms. If 
an instructor qets used to creatina presentation slides on their 
computer as well as workina with computer tools, they will want to 
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have a comDuter in their classroom to make use of these Droorams . 
Similarly, if instructors are expected to use comouter software 
in their classroom, thev will need PCs in their offices and at 
home in order to oreoare their classes. In other words, widesoread 
use of PCs in training reinforce the need for electronic classrooms 
and vice-versa. 

Embedded Trai ning 

Embedded trainina is instruction that is an intearal comDonent of 
a oroduct or svstem. To the extent that a oiece of eouioment is 
comouter-based and has a disolav oanel , it becomes feasible to 
build the trainino into the eauiDment. In a comDuter svstem, it 
is easv to provide online trainino as oart of the system. Embedded 
training often takes the form of helDs or tutorials that explain 
how to perform a specific ooeration or task on the svstem or 
equipment. Embedded training can also take the form of Derformance 
support systems tha* involve Drovidino emolovees with comouter 
tools that helD them do their job more effectively. 

Embedded training has manv advantaaes over anv other form of 
instruction for learning to use eouioment or systems. The most 
important characteristic is availability -- training is alwavs 
available when needed. Secondly, the trainina is specific and 
focused on the immediate needs of the user trvino to learn how 
to operate (or repair) the eouipment/svstem. Thirdly, the trainino 
should be up-to-date and tied to the Darticular eouioment/svstem. 
Embedded training also simplifies the logistics of providing 
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training to customers or emolovees since it is delivered alona 
with the oroduct or svstem. 

OOD has mandated that all new weaoons systems will include 
embedded trainina. This has focused the interest of military 
R&D contractors on embedded trainina. Most new comouter oroducts 
include h?lD systems. Some automated manuf actur ina systems also 
include built-in trainina and documentation. However, the 
development of embedded trainina reauires the involvement of 
trainina specialists as oart of the system desian orocess. 
Trainina materials have traditionally been develooed after the 
system or product is comoleted. This inclusion of trainina 
specialists as Dart of the desian t*am often reauires 
oraanizational chances and different skills on the Dart of 
the trainina department. 
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Effective embedded trainina is difficult to desian and manv 
current efforts are not verv successful. To be effective, the 
information available must address the soecific Questions or 
problems that peoole have when they are learnina to use a 
product or system. To find out what kind of Questions or 
problems will arise, it is necessarv to do a lot of emDirical 
work with prototypes and tVDical users. User testina earlv 
in the desian cvcle is a relatively new techniaue in svstem 
develoDment and most enaineers have not been trained in data 
collection methods (as trainina soecialists have). In addition, 
it appears that it will be necessarv to use artificial intelliaence 
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techniques to create embedded traininc programs that understand 
what the user wants to know. 



I ntelligen t Tutors & Exoert Systems 

For roanv vears, research has been conducted on the application 
of artificial intelligence techniaues to the desiqn of instruction 
(e.g.. Poison & Richardson, 19B8; Psotka, Massev & Mutter, 1988). 
Two different lines of research have develooed: intellioent 
tutoring systems and exoert systems. Both accroaches involve the 
application of artificial intelligence methods to instruction 
but in different ways. 
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Intelligent tutors are computer based instruction oroorams that 
understand the subject matter thev teach and can also understand 
the responses that students make to ouestions or Droblems Dosed 
by the program. Such programs include associative networks, the 
capability to make inferences based upon teaching rules, and 
the caoability to build models of the student in order to 
diagnose misconceptions and assess learning. Thev are designed 
quite differently from traditional comouter based instruction and 
have the potential to provide much more effective learning tools 
than current educational software (Kearslev, 1987a, 1989). 

Exoert systems are programs capable of asking questions and 
reaching conclusions based upon the answers provided for a 
specific domain. The rules used bv exoerts in that domain are 
identified and built into a program. The expert svstem applies 
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the .e rules to the information provided to produce conclusions. 
In realtime systems (e.a., in manuf acturina or military settinos) 
the data comes from sensors rather than answers to questions. 
When applied to trainina, expert systems can be used to helD 
students understand the factors involved in makino decisions 
or judoements (especially if thev construct the exoert systems 
themselves). Alternatively, expert systems can be used as 
intelliaent job aids that reduce or eliminate the need for 
trainina on a specific task. See the "Fliaht Plan Critic" 
for an illustration of how an exoert system can be used for 
pilot trainina. Applications of exoert systems to trainina 
are discussed further in McFarland & Parker (1990) and 
Lippert (1989). 

To date few intelliaent tutorina systems have actually been 
implemented in ooerational trainina settinas. Despite a lot 
of research in this area (mostly funded bv DOD), there are 
many fundamental issues in learnina and coonitive theory that 
have not been answered and will need to be before we Know 
how to desian intelliaent tutors that reallv work. Indeed, 
much of the research in this area has shown how limited our 
understandina of learnina is. Furthermore, the development 
of tutors takes an enormous amount of time and expertise in 
artificial intell iaence . At the present time, such systems 
are not economically feasible — the availability of better 
authorina tools and more instructional developers with 
experience in this area will likely chance this situation. 



EXPERT SYSTEMS APPLIED TO INSTRUCTION: 
THE FLIGHT PLAN CRITIC 



Expert systems are the proorams that use artificial intelliqence 
techniques to provide advice or reach decisions in a specific 
domain. Since a great deal of trainino involves teachino people 
how to solve problems or make decisions, expert systems would 
seem to have a qreat deal of promise for instruction. By capturina 
the knowledge of experts in a program, their experience is made 
widely available., 

The Flight Plan Critic is an instructional expert system developed 
to help aviation students learn how to plan a cross-country flioht. 
The project is a collaboration between Wicat Systems (a CBT vendor), 
the University of North Dakota, and Northwest Airlines. The expert 
system was developed using the WISE authoring system linked to 
0PS5, an expert system development lanauaae, runnina on a WICAT 
workstation. 

The student begins by developinq a fliqht plan using a variety of 
information available such as aircraft data, parsenaer/baagage loads, 
and maps. All decisions made by the student are recorded. When the 
student completes the flight plan and files it, the plan is analyzed 
by -he expert system which examines its correctness, diagnoses errors 
ana provides feedback to the student including prescriptions that 
will help the student reach mastery. 

Even though the program was developed by an experienced CBT team, 
it introduced many new considerations. Extracting enouah information 
from the student's resoonses to dlaanose problems was difficult and 
required the adoption of a "mixed initiative" approach in which the 
expert system would present its advice but let the student decide 
what to do with it. Determinino when to give feedback and what kind 
of feedback also presented many design problems. The development 
of the Flight Plan Critic reveals many inadeauacies in our current 
instructional theories and design techniques for computer based 
training regarding the analysis and representation of student 
comprehension during learning. 

The Flight Plan Critic is now being tested with aviation students 
and being "fine-tuned" by its developers. The prooram represents 
one of the first instructional expert systems to be used in an 
operational setting usino a commercially available CBT system. The 
project demonstrates that existing authoring tools can be extended 
to accommodate expert system and intelligent tutoring capabilities. 
It also illustrates that the development of new forms of interactive 
instruction will require substantial new research about learning 
and teaching. 



By contrast, exDert systems are much faster to develop and 
do not require artificial intelligence experience in order 
to use. The current aeneration of author 1 no tools for buildino 
expert systems are relatively easy to use and inexpensive. 
Many colleoe students develop experts svstems for term 
projects in education, management science, medicine, and 
computer science courses. It is conceivable that instructors 
could have trainees in management, marketino, and technical 
areas develop expert svstems to helo them learn a subject 
matter and create "fob aids for themselves and fellow emolovees. 
In order for expert svstems to be used in trainina settinas. 
Instructors must be comfortable with them and students must 
have easy access to computers durina trainina and back at the 
job. 



Interactive Multimedia 

In the previous chapter, the increasino use of interactive 
videodisc for trainina aoolications was discussed. While 
most trainina soecialists are enthusiastic about the value 
of interactive video to learning-, the current videodisc 
systems are too expensive and have a number of limitations 
that prevent widespread adoption. One limitation in particular 
that presents problems is the small amount of dvnamic video 
(maximum 30 minutes) that can be stored on a videodisc. 
Another major limitation is that videodisc (as well as CD-ROM) 
is a read-onlv medium that does not permit local customization. 
Lack of local master ina/duolication capabilities for optical 
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media is another factor that limits its use. 

A considerable amount of research with new forms of oDtical 
media is takino place (e.o., Ambron & Hoooer, 1988; Havnes, 
1989; Souter, 1988). Laroe consumer electronic firms such 
as Sony, Philips, and Matsushita are workina on new forms of 
comoact disc (CD-ROM XA and CD-I) that orovide areater 
storaoe capability. Intel has develooed another technoloov 
called DVI (Dioital Video Interactive) that involves comoressed 
video and addresses the limited video caoacitv of videodiscs. 
Some comoanies market a read/write ootical disk svstem (e.o., 
Panasonic) and at least one computer vendor (NEXT Inc.) has 
incoroora* d such a disk svstem in their Dersonal comouters. 
These develoDments are likelv to lead to ootical media that 
overcome the limitations of current videodisc technoloov for 
multimedia instruction. The further develoDraent of hvDermedia 
systems (discussed in the next section) is also likelv to 
facilitate the use of interactive multimedia. 

At the present time there are onlv a few trainino oroanizat ions 
exper imentinq with these new forms of interactive multimedia. 
Applied optical has develooed a truck driver simulator for 
Du Pont that uses DVI technolooy. Federal ExDress is usino 
CD-ROM to distribute trainino materials to all of its emDlovees 
on a monthly basis, it is likelv that manv of the current 
interactive videodisc Drojects in trainino will eventually 
miorate to these new technoloaies to take advantaoe of the 
additional capabilities they offer. 
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Hyper text /Hypermedia 

Hypertext describes a new method for oroanizina online databases 
that allows users to jump from one idea to another at their 
whim. This is accomplished bv identifvina links between text 
strinqs or araohic objects durino the creation or use of the 
database. The linked information can also be multimedia in nature 
such as audio or video seouences in which case the database is 
called hypermedia. Hvpertext/Hvpermedia make it easv to browse 
around a laroe database and Dursue connections between different 
items of information. Many scientists suooest that hvoertext 
capabilites will have a sianif leant impact on how oeoole use 
ccmputers in the future (e.a., Barrett, 1989; Jonassen, 1990; 
Shneiderman & Kearsley, 1989). 

Hypertext appears to have sianificant value to the trainina domain 
When used for colleae courses, students seem to learn more about 
the subject area when thev use hvoertext databases to studv with. 
In the technical trainina domain, one of the most serious Droblems 
is the tremendous amount of detailed information that emolovees 
must learn about eauiDment or procedures. Hvoertext can Drovide 
a way to oresent a lot of information that is easier to learn 
and use for reference. Hvoertext/Hvpermedia seems to match 
the needs of embedded trainino systems very well, especially it 
optical media is used for multimedia storaae of information. At 
the Dresent time, there is a areat deal of exoloratorv work with 
hypertext/hypermedia at universities but not much in the trainina 
world. f*,. 



Dlaital Networks 



One of the most iraoortant areas of technolooical development we 
can expect to make sianificant orooress durino the next decade or 
two is diaital networks. The arowth of dioital networks in the 
next two decades can be likened to the development of an 
interstate hiahwav svstem in the first half of the this centurv. 
At the present time we have low sDeed/low bandwidth lines 
equivalent to dirt roads; in the future we will have hioh sDeed/ 
hiah bandwidth ooticai fiber on Dar with expressways . Such 
"diaital expressways'* are necessary to handle the hioh volumes 
of electronic messages and television sianals associated with 
computer based trainina, teleconferences, and hypertext systems. 

Parenthetically, it should be noted that the automobile analooy 
is probably appropriate for a number of reasons. As data networks 
evolve from the dirt road to the expressway staaes, thev are 
likelv to brine about malor chanaes in the nature of work and 
the way we live -- not all of which will be beneficial. For 
example, we mav have the electronic eauivalents of automotive 
pollution ("information pollution"), rush-hour conaestion 
("network saturation"), and urban blioht (proliferation of 
network eouioment). The hope is that such side-effects will 
be recoonized earlier and manaoed better than with automobiles. 

The increasino availability of dioital networks is likelv to 
profoundly impact the nature of trainina. Such networks will 



make the transmission of video and araohics information as 
inexpensive as voice. This will reduce the financial obstacle 
to teleconf erencina and increase its use substantially. Once 
it is cheap and easy to transmit multimedia information fin 
conjunction with widesDread ownershio of suitable workstations, 
use of ootical storaae, and expert svstem/hvpertext interfaces ), 
we can expect to see more embedded trainina and distance learning 
approaches. This will likelv mean that trainino becomes more 
informal and self "directed (see the I3M 2000 case studv). 

One nascent technoloov that could make a bio difference to the 
evolution of diaital networks is direct broadcast satellite (DBS) 
ecuioment. At the current time, transmission to satellites (uolink 
feeds) requires expensive and complicated eauipment limitino its 
use to oraanizations . However, it is conceivable that transmitters 
could be miniaturized to the size of a small box or circuit card 
that would be a oersonal computer attachment. This would allow 
any individual to directly transmit information via satellites 
and hence open uo the capacity of diaital networks enormously. 
Of course, a verv laroe number of satellites would be needed to 
supoort the transmisson capacity needed for DBS technoloov 
(space bl iaht? ) . 

Barriers to Lono-Term Imolementat ion 

In this chapter, we have briefly surveyed some of the new 
developments in technoloov that are likelv to affect trainina. 
The extent to which these develooments impact the trainina 
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THE IBM EDUCATION 2000 SCENARIO 



IBM has always been a leader in the training domain, especially in 
the use of instructional technology. An important part of the IBM 
corporate culture is the value of well-trained employees and hence 
a high priority is placed on training activities at all levels of 
the organization. IBM was one of the first companies to try out 
and implement computer-based instruction, interactive videodisc, 
and teleconferencing for internal and customer education. 

In 1989, IBM commissioned a well-known HRD think tank to develop a 
scenario of how they raiaht conduct trainina in the year 2000. They 
provided a detailed description of what they expected the company 
and the business climate to be at thaw time. By 2000, IBM expects 
to be a highly decentralized organization with most of its revenue 
coming from information systems services (not products). It expects 
the workforce to be older, multicultural, and well-educated. They 
anticipate that most employees will work in temporary project teams 
assembled for specific customer or obi ems and will not have fixed 
job positions. The company will have a very flat and dynamic 
organizational structure. 

Given this background picture of IBM, the following training scenario 
was developed: 

* Most training will take place as self-directed learning in the 
context of job assignments rather than in scheduled classes. The 
self -directed learning will normally take place at the job site. 

* There will be little distinction between the systems used for 
learning and those used for job tasks. The employee will learn 
and work using a multimedia workstation. 

* Electronic networks will be fundamental to learning and job 
activities. Employees will interact with each other via online 
messaging and conferencing svstems and acquire information 
needed through searching multimedia online databases. 

* The major role of the trainina staff will be to act as resource 
managers helping employees find information and develop skills 
needed for their current project assignments 

* The major role of managers will be to act as advisors/mentors 
to the employees assiqned to them and facilitate communication 

* A sophisticated Human Resource Information System will be used 
to track employee skills and match them up with project needs 
and available trainina resources 

This scenario paints a much different picture of trainina than is 
currently the norm. It suaaests that the employee workstation will 
be the focal point for most learnino. However, much learnina will 
occur through aroup interaction in the form of teleconf erencina 
rather than the traditional type of computer based instruction. 
Furthermore, learning will be tied to the needs of specific 
project assignments rather than job positions. Training specialists 
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and managers will need to focus much more on the micro learnino 
needs of specific individuals rather than the macro needs of 
large groups. In general, this scenario predicts that training 
activities will become much more complex to deliver and administer 
than at present. 



world and how raoidlv is dependent uoon a number of factors 
including: (i) how much emphasis is Dlaced uoon technoloov in 
HRD departments and trainino proorams, (ii) the technical 
sophistication of oeoole attracted to the trainino orofession 
and, Uii) the amount of federal fundina allocated to R&D for 
research in instructional technoloov. 

In order to institutionalise the use of instructional technoloov 
in any oroanization, it is necessarv to have a hloh decree of 
support and committment toward trainino from the senior 
manaoement of that oroanization. Because projects involvina 
technoloov reouire sionificant capitalization and usually take 
a lona time to bear fruit, thev must have strono and consistent 
support from the too. For this to haooen, the comoanv must 
really believe in the imoortance of effective trainino and 
the potential of technoloov to help achieve this ooal. Thus, 
the culture of an oroanization must encouraoe instructional 
technoloov if it is to have a lono-term effect. 

Creatine and sustainino such a culture comes from the ranks 
of the trainino department as well as senior manaoement (there 
must be both "push" and "duII"). In order to sell the rest 
of an oroanization on usina technoloov, the trainino staff 
must have the necessarv backoround and exoerience. This means 
that thev must hire new trainino staff with instructional 
technoloay deorees for retrain existino staff). The comoanv 
must also Drovide R&D funds to explore technoloov aooroaches. 
Projects involvino technoloov are almost alwavs innovative in 
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nature and hence reouire time/monev for testina and tunino 
alternatives. Unless a training department is allowed to 
conduct such R&D activities, they are not likelv to become 
verv sophist icated about the use of tecnnoloav for operational 
settinos, even if the trainina staff have the aoorooriate 
formal backoround. 



When an oraanization does suDDort trainina R&D projects, 
these efforts are usually Droorietarv and verv narrow in focus. 
Onlv the laraest companies (such as IBM, AT&T, Motorola, GM ) 
can afford to conduct their own research projects and thev 
are usually not Dublicized widely nor evaluated r icrourousiv. 
Federal suooort of R&D in instructional technoloov is 
essential for the field -o mature. Laroe scale fundino 
of new ideas, demonstration orojects, and basic research 
catalyzes the oace of develooment in oraanizations and 
stimulates university activities. We can see this verv clearly 
in the case of DOD suooort of instructional tecnnoloav — 
almost all of the advances in this area over the oast 
two or three decades have occurred in military trainino 
projects. If civilian aaencies (e.a., the Deoartment of 
Labor or Department of Commerce) took over the leadershiD 
role in fundino instructional technoloov research, it is 
likely that technoloov would be much more prevalent. 



The three barriers to lona-term implementation just discussed 
are closely inter-related. Serious commitment bv oraanizations 
to the use of instructional technoloov creates a demand for 
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trainina professionals with expertise in the area. Federal 
fundina of R&D in instructional technoloov supports university 
activities in the field which in turn provide the sDecialized 
courses needed to train instructional technolooists . The results 
of research projects encouraoe oraanizat ions to try thinos an- 
avoid dead ends. In other words, the lona-term viability of 
instructional technoloav is seen as a oroblem of establishina 
and maintainina an infrastructure rather than debuoaina the 
technoloav itself (which is a near-term issue). Historically, 
this infrastructure has been Drovided bv DOD to serve military 
rather than civilian trainina needs. 

Summary 

This chapter has reviewed a number of emeroina developments 
in technoloav that are likelv to affect trainina in the future. 
These develooments include: widesoread ownershio of Dortable 
workstations, electronic classrooms desioned to suoport 
instructional technoloav, Droducts and systems with embedded 
trainina, use of intelliaent tutors and exDert systems, forms 
of interactive multimedia with more capacity, hypertext svstems 
that improve access and usability of online databases, and 
diaital networks that reduce the costs of information sharina. 
The net effect of all of these develooments will be to make 
instructional technoloav more Dowerful, less expensive and 
more widelv used. The major barriers to development are: 
lack of support for the use of technoloav in oraanizat ions , 
lack of trainina professionals with the necessary expertise 
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to use technoloav, and lack of sufficient R&D fundino at the 
federal level to keeo the ball rollina. 
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IV. INSTRUCTIONAL TECHNOLOGY: DEVELOPMENT TOOLS 

One element of instructional technology that has not been 
discussed in detail so far in this reoort is the nature and 
imoortance of the software tools available to develoo trainino 
materials. Like most other areas of human endeavor, better 
tools can imorove the Droductivitv of trainina develooers. 
Until very recently, the development of trainina Droorams 
has been strictly hand-crafted and hiohlv labor-intensive. 
One of the reasons why trainina Droarams (especially those 
involvina technoloav) cost so much and take so lona to develop 
is that every steo in the process must be done manually. 
Variations in the skill and exoerience of trainina develooers 
result in variations in the aualitv of trainina Droarams and 
materials. Despite some attention to aualitv control methodoloay 
(i.e., formative evaluation), the outcomes of trainina courses are 
often unreliable and not as intended. 

In the Dast few vears, it has become clear that we can develop 
software tools that will help us desian, develop and implement 
better quality traininq. it should be emphasized that this area 
is still in an earlv R&D staae (with the exceotion of authorina 
systems) and hence is not ready vet for widespread implementation. 
This chapter provides an introduction to and overview of current 
work on instructional development tools beainnina with a discussion 
of authorina systems. More backaround on authorina tools is provided 
by Kearslev ( 1987b) . 
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Author i no Systems 



Author ina systems are proarams that write other Droarams. Thev 
allow an instructional develoDer or subject matter expert with 
no proorammina backaround to create a comouter-based instruction 
course. When the content is orovided and the nature of the 
interaction is specified from menu choices, a oroaram is 
automatically generated bv the author ina system. Not only does 
an authorina system eliminate the need for oroarammina but it 
also creates a buo-free proaram. Eliminatino the need for 
proorammina and debuaoino can reduce develooment time bv a 
substantial amount. So, authorina systems have two orinciDal 
benefits: thev make it Dossible for almost anvone to develop 
their own comouter based instruction courses and they cut the 
time required to do it. 

Todav there are dozens of authorina svstems available tor all 
types of personal comouters and mainframe systems. Most of them 
support interactive video and Drovide student manaaement 
capabilities. For some of the more oooular svstems, there are 
also user oroups and consultants available for trainina or 
contract development work. All of this makes it relatively 
easy for individuals and oraanizat ions to aet involved in 
computer based instruction without a maior investment. Prior 
to the availability of authorina svstems, the develooment 
of instructional software reouired the use of aeneral purpose 
proorammina lanauaaes or authorina lanauaaes ( Droaranunina 
lanauaaes specifically desianed for creatine instructional 
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programs ) and necessitated the involvement of oroorammers. 



Most commercial organizations that develoo courseware create 
their own author ino svstems or use author ina lanauaoes to 
avoid licensina constraints, maximize program oer f ornr»nce , 
or ensure maintainabi 1 itv/oortabilitv. in larae-scale courseware 
develooment, the availability of libraries of screen formats, 
araDhics, and resoonse orocessino seauences becomes the sinale 
most iraDortant Droductivitv factor since reusino thinos alreadv 
develooed is the best wav to save time. Some author ino svstems 
come with such libraries develooed bv the vendor and/or users. 

Author ina svstems have evolved to the point that the Droarammina 
aspect of desionino computer-based materials is no lonoer a major 
consideration in the develoDment Drocess (other than to choose 
which svstem to use). Instead, the focus is on the desion of the 
courseware. An author ino svstem makes it Dossible to imolement 
any screen or sequence if you know what vou want to do and the 
best way to do it. Unless thev have had soecific trainino in the 
desion of interactive instruction, most instructors or trainino 
developers do not have a clue how to create effective comDuter- 
based learnina materials. Experience carried over from the 
desion of print materials or the DreDaration of classroom lectures 
does not helo much. So the ma?3r limitino factor in the use of 
authorina svstems is not th^features of the ©articular authorina 
system used but the desion skills of the develooer. This is one 
of the reasons why current attention in the authorino system 
area is devoted to the creation of automated instructional 



development systems and instructional development expert systems. 
Automated Instructio nal Develo pmen t Systems 

Larae oraanizat ions and the DOD freouentlv develoo courses that 
involve hundreds of lessons and take years to complete. For 
projects of this maanitude, there are bio payoffs to any 
automation of the instructional desion process. Over the oast 
5 years, a number of companies have developed orototvoe 
systems, some of which have oone into operational use or 
become commercial oroducts (see Table 2). Most of these 
systems focus on the front end analysis aspects of develooina 
instruction: task analysis, behavioral ob-fectives, and 
syllabus creation. Many of the systems also provide orolect 
manaaement capabilities specifically oriented to the needs 
of trainina efforts. Since many of these systems have been 
developed for military oroiects, thev are often linked into 
military specifications and integrated loaistics support 
requirements . 

Automated instructional develooment systems could improve the 
productivity of trainino developers in many ways. Bv doino 
the mechanical aspects of tasks (e.g., sortina information, 
drawino charts, tabulating; numbers), considerable time can be 
saved. Bv orovidino templates for common tasks (similar to 
the libraries used in authorina systems), even more time can 
be saved. Once data is entered into the svstem, it can be 
reused in every subseauent task that involves that information. 
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TABLE 2 



AUTOMATED INSTRUCTIONAL DEVELOPMENT SYSTEMS 



System 



Developer 



Scope 



Status 



ISD Tools 



ISD Inc. 
San Diego, CA 



All aspects of ISD 



proprietary 
in-house use 
IBM PCs 



Expert Media 
System 



IntelliSys Inc. media selection 
Syracuse, NY (see Olson, 1988) 



commercially 
available 
IBM PCs 



Pehavior Ob j . 
Problem Anal 
Cost/Benefits 



Park Row Inc. 
San Diego, CA 



front end analysis 
(see Kearsley, 1988) 



commercially 
available 
IBM PCs 



LOC Tool 
I3D/LSAR 



DRC 

Wilmington, MA 



objectives, 
ISD logistics 



research 
IBM PCs 



VISTA 



Naval Trnq Ctr 
Orlando, PL 



front end analvsis 
(see Maxey & Ahlers, 
1989) 



research 
IBM PCs 



IDA/CWCM 
IRVING 



MacDonnell- 
Doualas CorD 
St. Louis, MO 



front end analysis 
( see Cross et al . , 
1989 ) 



research 

Macintosh/ 

HyperCard 



IDE 



Xerox PARC 
Palo Alto, CA 



front end analvsis 
(see Jordan et al . , 
1989) 



research 
Xerox 9000/ 
NoteCards 



ISC 



IS Assoc. 
Alexandria VA 



inteqrated logistics 
support 



conmercially 
available 
ISM PCs 
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Combined with project manaaement software and electronic mail 
capabilities, automated instructional development systems can 
improve project trackino and facilitate the flow of information 
between team members and clients. 



Even thouah most of these systems have been desioned as 
research vehicles to investioate how automated tools could 
improve the aualitv or efficiency of trainina development, 
verv little research about the instructional development 
process has vet to be conducted. To date, the systems are 
of the "proof -of -concept" variety, i.e., demonstrations that 
workina systems can be built. No studies of how the results 
of automated systems compare to manual procedures or what 
kinds of time savings miaht be realized have been carried out. 
It is clear that the development of automated systems will 
require a areat deal more detailed examination of the 
instructional desian Drocess since even the most exDlicit 
and procedural models of instructional development do not 
provide the level of detail needed to create Droarams. 
What this line of research has shown us so far is that we 
have a verv fuzzv understandina of how Deonle create 
instruction {Kearslev, 1984b). 

Incidentlv, it is interestina to note that the impetus for 
the develooment of automated instructional systems has not come 
from the comoanies that develop and market authorina svstems. 
To date these two cateaories have laraelv followed separate 
paths. The comoanies involved with authorina svstems tend to 
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focus on the CBT/IVD marketplace whereas those involved with 
automated ID systems are concerned with trainino systems 
generally. To the extent that CBT and interactive video are 
becominq major forms of instructional delivery, it seems that 
it would be a aood idea for these two tracks to merge. In 
particular, it would be nice if the outputs of front end 
analysis oroaxams could be automatically fed into the 
storvboardina process for CBT/IVD oroorams. The final link 
in a fully automated system would be a orooram that could 
convert completed storvboards into workino oroorams. 

E xpert System s 

In the previous chapter the use of expert systems as part of 
the teachino/learninq otocess was mentioned. One of the most 
important applications of expert systems mav be to orovide 
intelliaent job aids or "advisors" for instructional developers. 
A number of prototypes of such systems have been developed. 
In fact, at least two of the commercially available systems 
listed in Table 2 (the Exoert Media Svstem and the Park Row 
Behavioral Objectives oroaram) Incororate expert svstem 
techniques . 

The ID Expert is a Macintosh/HyperCard oased expert svstem 
beinq developed bv M.D. Merrill at Utah State University with 
DOD fundino (See Merrill & Li, 1989). The svstem is intended to 
quide novices throuoh the instructional desian process as well 
as speed uo the Droduct ivitv of experts. ID Expert consists 
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of hundreds of rules about instructional desian that can be 
invoked at anv staae of the desian process to aive advice or 
complete a task. Based uoon the content information provided , 

m 

the svstem can suaaest oroanisat ional or teachina strateaies 
as well as make recommendations about the best desian approach. 
Another svstem called Expert Computer Manaaed Learnina is 
beina developed by CBT Svstems of Calaarv sponsored by the 
Alberta Research Council. TMs svstem not onlv helos desioners 
create a course but also provides advice on evaluation and 
course administration. 

Oevelooino an expert svstem tor instructional develooment 
runs into the same oeneral problem facina automated instuctional 
develooment svstems — the lack of detailed knowledae about 
how to desian instruction. However, expert svstems are a little 
easier to construct because all vou need to find is an exoert 
who can consistently perform a task with aood results. Then the 
oroblem of buildina the svstem is a matter of knowledae enaineerina, 
i.e., reoresentina the expert's knowledae in terms of procedural 
rules. While this is not an easy thina to do, it has become a 
routine activity for expert svstem develooers. It seems likely 
that expert systems for instructional develooment will proliferate 
in the comina vears. The dilemma will be for consumers to 
decide whose expert system thev want to use. This is likeiv to 
be an area rioe for a lot of marketincr hvpe as well a few honest 
evaluation studies. 
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Summa ry 



The development of tools to facilitate the development and 
implementation of trainino materials and oroQrams oromises to 
be a major area of research and commercial activity in the 
next decade. Author ina systems for the creation of comouter 
based instruction have already established themselves as a 
major cateoory of software tools for trainina departments. 
Work on automated instructional development systems that 
cover all aspects of analysis, desion, and evaluation is lust 
beainnina. The application of expert systems technoloav to 
instructional development is at an early staqe but is likely 
to catch on quickly. We can expect the development and 
marketina of automated instructional systems and expert 
systems for traininq to be a major undertakinq in the comino 
decade. As more and more trainino personnel use computers, 
interest in such tools will increase. 



The overall impact of these tools is to make it easier and 
faster to develop trainina proorams. Less exoertise will be 
needed to create hioh-auality trainino materials because the 
tools will contain instructional des ion/development expertise. 
Note that this impact should be felt in all aspects of trainino, 
not just those involvina instructional technoloav. 
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V. TECHNOLOGY & TRAINING: ISSUES 
This chapter discusses how the current and future apolications 
o£ instuctional technology relate to imoortant issi'~s ip the 
training field. The issues include: retrainincr, basic skills, 
team training, participative manaaement , distributed training, 
multiculturalism, technoloav transfer, and HRD trainino. Manv 
of these issues are documented in recent studies conducted for 
the Deoartment of Labor (e.g.. Quality of Work Life; ASTD). 

Retraining 

A major issue in the technical trainino area is emDlovee 
retrainino. The impact of introducing new technoloav into 
manufacturing is to make the skills and knowledae of manv 
workers obsolete. In manv cases, the nature of the job 
changes dramatically reauiring quite different skills and 
knowledge. For examole. when a robotic svstem reDlaces 
manual labor in an assembly line, the new jobs involve the 
supervision, programming, and reoair of robots. When 
electronic circuits replace electromechanical ones, the 
repair skills and troubleshoot ino knowledae needed 
is different. On the other hand, the outcome of new technoloav 
in the workplace is sometimes in the oPDosite direction - it 
F3k«?s the new job almost menial reouirina no specialized skills 
at all. For example, someone who used to actually Derform a 
task is asked to supervise an automated assembly line and monitor 
the "idiot" liahts. 
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Retraining employees can take a number of different forms 
depending upon what kind of career choice they oot for. if they 
decide to upgrade their skills to match the needs of the new 
technology, they could require a lenathv training procram that 
reguires months or years. If thev decide to switch jobs and 
try a new career, this could also involve a long training oeriod. 
If they decide to stay with the old job in a deskillinq situation, 
the training is likely to be on the job and relatively minimal. 



Instructional technoloav would seem to have a lot to offer in 
any of these alternatives. To the extent that minimizing the 
length of the training time is highlv desirable, the use of 
CBT would seem to be aDDrooriate since it consistently reduces 
the training time reguired. In most cases, workers undergoing 
retraining are older and less motivated to learn new skills and 
jobs than vounaer workers just enterino the workforce. The use 
of interactive multimedia is more likely to capture and sustain 
their attention than traditional classroom instruction. Since 
a lot of learning is likelv to occur on the job (especially 
in the upskillino situation), embedded training that is built 
into the new equipment or svstems is highlv desirable. In 
addition, expert svstems that can compensate for missing 
skills and knowledge would seem to be a aood idea for workers 
who are not completely retrained. 



The bottom line is that workers in a retraining situation cannot 
afford the consequences of Door instruction. There is a lot 
hiqher probability that training that uses technology will 
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orovide better oualitv instruction than conventional methods. 
This should be a comoellino reason whv instructional technoloav 
be used in most retrainino situations. 

Basic Skil ls 

The extent of illiteracy and lack of basic skills amono a 
larae proportion of the adult ooDulation is well documented. 
Not onlv does this limit Deoole from carrvina out their 
current lobs Drooerlv but it Dresents a sionificant obstacle 
to any form of retrainino since more advanced skills as well 
as the learnino orocess itself are aoino to be dependent uoon 
basics. Indeed, it is verv common for remedial instruction 
in basic skills to be the first Dhase of a retrainino Drooram. 

Instructional technolooy can contribute to imorovement in 
basic skills in a number of wavs . Comouter based instruction 
and interactive video have been shown to be auite effective 
in improvino basic skills with adults (See "Functional 
Literacy and Interactive Video" case study). Bv orovidino 
individualized instruction in the soecific areas where a oerson 
is weak, it is possible to rapidlv imDrove their level of readina, 
writina, or mathematical ability. The use of interactive video is 
especially heloful because it minimizes the amount of readina 
needed. The use of electronic mail has been shown to improve 
the written communication skills of students. The interactivity 
and feedback provided bv technoloav are important in motivatina 
students who are tvoicallv poor learners to keep aoina. 
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FUNCTIONAL LITERACY & INTERACTIVE VIDEO 



Doroinos Pizza faces a problem common to many organizations: employees 
who have very limited basic skills. Limited readina skills are 
especially problematic because it orevents emolovees from learning 
how to do their job usina printed training materials. To deal with 
this problem, Dominos adopted an innovative approach to trainina 
employees how to make pizza usina an interactive videodisc system. 

The purpose of the dough certification proaram is to ensure that 
the pizza dough made in each of 30 plants is consistent in quality. 
The original program involved thick training manuals and videos 
as well as written test. Employees found the manuals and test 
itimidating and did not do well in the training. In 1987, with 
support from the U.S. Department of Labor, Dominos set out to develoo 
an interactive video program that would accomplish the same trainina 
and at the same time remediate any basic skills deficiencies that 
occurred during the training. 

Employees interact with the system usina a touch-sensitive screen, 
respond to questions, select correct orocedures, and stop the 
program action when somethina incorrect is shown. The proaram uses 
animated characters for the narrator and a villian ("the Noid") 
and involves game strateaies. To deal with literacy problems, the 
program provides for four levels of comprehension: literal, 
inferential, critical, and creative. Questions can be aenerated at 
all four levels and adapt to the level of responses made by the 
employee as they go through the course. Thus, deficiencies in 
basic skills are addressed as an intearal part of the instruction 
rather than as separate remedial lessons. 

While teaching employees how to prepare pizza douah properly is 
the primary purpose of the oroaram, it also achieves a secondary 
goal — improving the literacy skills of all emoloyees who take 
the course. The use of interactive video makes the course 
interesting to employees and differentiates if from "school 
learnina" which many- emolovees dislike. The svstem solves two 
problems simultaneously: getting emolovees to comolete training, 
and dealing with basic skills problems. 



Intellioent tutors raav be most aoDlicable to basic skills 
instruction. One of the most oowerful features of such tutors 
is their diaonostic capability. Students who are weak in basic 
skills often have difficulty learnino and reauire a lot of 
extra helD. Tutorina proqrams would be able to determine exactl 
what Droblems a student is havina and provide remediation. 
Considerinq how exoensive and time consumino it is to develoD 
tutors, it makes sense to focus on basic skill areas where 
there will be a laroe DODulation t"» justify the effort. 

0 ist r ibuted Trainina 

Travel required to attend trainincr classes has always been a 
major expense cateaorv associated with trainino (not to mention 
lost job Productivity and home life disruption). Most companies 
and employees would be deliahted if effective trainina could 
be provided at the job site, eliminatino the need for travel. 
Furthermore, the economic benefits to oraanizat ions can be 
immense. For example, Bowsher (1988) reports that IBM saves 
about $200 million per year bv usino self-study trainino 
approaches. However, it has been hard to break the tradition of 
trainina centers and classroom instruction. 

There are many reasons whv distributed trainina is hard to 
implement successfully (see Kearslev, 1985, for a complete 
discussion). When oroanizat ions trv distributed trainina, 
thev make many mistakes. For example, thev exoect employees 
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to learn at their job site or at home. Neither of these daces 
provides a suitable learnina environment for most employees. 
Instead, it is often necessary to provide a room or center 
desicrned specifically for learnina that is free from workolace 
or home disruptions. Another common mistake is to simolv Dackaae 
lecture notes in orint and video form. To be effective, distributed 
learnina materials must be hiahlv interestina and Dreferablv 
interactive. The examples and motivation normally orovided 
as Dart of the classroom exoerience must somehow be included 
in the materials. 

Instructional techno.loav can olav a Divotal role in makina 
distributed trainina work. Comouter based instruction and 
teleconf erencina orovide interactivity which maintains the 
motivation of the learner. Furthermore, these technoloaies 
allow students to interact with the instructor and each 
other substitutina for classroom interaction. The use of 
networks allows students to share information and access 
online databases extendina their reach far more than the 
confines of a classroom. As efforts like NTU and other 
distance learnina orolects demonstrate, it is oossible to 
provide a much areater selection of learnina alternatives 
throuah the use of technoloay than with conventional 
instruction. To the extent that the trainina is available 
via the same workstation used on the iob and blends seamlessly 
with work activities, distributed trainina is likelv to be 
successful 
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Part icipat ive Management 

Studies and scenarios of the future suooest that the structure 
of most oraanizations will be much flatter and less hierarchical 
than in the past. The nature of manaaement will chanae from a 
directive, supervisory role to one of information provider, 
coach and coodinator. Effective manaaement stvle will be hiqhlv 
Dart iciDative, allowina emolovees to be relatively autonomous 
and indeoendent. 

In order to facilitate this stvle of manaaement, the nature of 
manaaement trainina needs to be chanaed . Althouah a lot of 
lip service oiven to the conceDt of participative manaaement, 
relatively little trainina alona these lines is orovlded. We 
need more attention to communication and interpersonal skills. 
Manaaers also need to tauaht how to helo emolovees find 
information rather than to be a source, in other words, manaaers 
need to be tauaht information handlino skills. 

Instructional technoloav can Dlav a role in more effective 
manaaement trainina. Interactive videodisc can be a hiohlv 
effective wav to teach communication and interoersonal skills 
since behaviors can be visually modelled and the effects of 
aood/bad interventions shown real isticallv. Exoert svstems 
car. be used to helD manaaers become more adeDt at analvzina 
problems as well as Drovidina decision tools. Teleconf er enci no 
can be useful in teachina manaaers how to Drovide access to 
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resources that are not immediately available. In manaoement 
trainina, the emDhasis needs to be Dlaced on usina technolooy 
as a tool rather than to deliver instructional content. 

There is also a hidden aaenda is usina instructional technoloav 
as much as Dossible for manaoement trainina. The more exoosure 
manaaers have to successful uses of technoloav in trainina, the 
more supportive thev are likelv to be for the use of technoloav 
for other kinds of trainina. As discussed in Chaoter III, a major 
obstacle to the institutionalization of instructional technoloav 
in oraanizations , is the lack of support from manaoement. Havina 
experienced positive examples in their own trainina, n>anaoers can 
become advocates instead of obstacles. 

Team Traiivina 

Many jobs (if not most) involve coordination with other emDlovees 
to oerform satisfactorily. However, few Deoole ever have anv formal 
trainina in how to do their job as Dart of a team. Mosi: trainina 
focuses on individual skills and knowledae. Learnina how to work 
as part of a team is usually somethina acauired on the job. Manv 
people perform poorly in their jobs because they cannot function 
well as part of a team. This applies to manv different types of 
work such as emeroencv services, manuf actur ina, sales, and 
construction. Indeed it appears that the importance of team-work 
at all levels of employment will increase as more and more 
workers interact via some form of computer or telecommunications 
network . 
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There are a number of different wavs that instructional technoloov 
can affect team trainina. In Chanter II, we discussed the use of 
networked simulators in military crew trainina and the oossibilitv 
of expandina this aporoach for civilian jobs usina interactive 
videodisc. The use of teleconferences can facilitate aroup 
interaction and problem-solvina. Computer-based simulations can 
help people to see the impact of their actions on other Deoole 
and the orqanization. Hypertext systems may also be helDful 
in lettina people see the connectivelv between asoects of their 
job and others. Finallv, intelligent advisors and expert svstams 
may help people work tooether and become an active comoon«»nt of 
a team. 

It should be emohasized that team trainina is a relatively 
nealected oart of the trainina sDectrum and there is iittle 
research or Dractice to build on. On the other hand, there 
is also no strona tradition of classroom instruction in this 
area to overcome. It would seem like a aood area for exploration 
with instructional technoloov. 

Multicultur al i s m 

One of the very imoortant demooraDhic trends that is likelv to 
have a profound impact on the nature of trainina proarams is the 
increasina multicultural makeup of the U.S. workforce. While the 
U.S. workforce has alwavs been a "meltina Dot" of different 
cultures, the scooe of diversity is now much oreater soannino 
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large percentages of African* Middle Bast, East Asian, Indian, 
Caribbean, and Central/South American immigrants. Furthermore, 
there is a much stronaer tendency to retain lanauaae and customs 
that in past generations. Thi* means that trainina proara.ns 
need to be designed to support different languages and cultural 
learning stvles. 



Instructional technology c?i address the multicultural issue. 

For example, CBT and interactive videodisc can easily orovide 

a choice of language and Dresent information in slightly different 

ways for different learners. Video and television can be 

dubbed with othe.* languages. Online databases and helD systems 

can be available in multiple languages. Teleconferences can 

use interpreters to translate questions from participants. 

Because of the economies of scale involved in most aoolications 

of instructional technology (e.g., large student DODulations) 

and the longer development cvcle. it becomes feasible to 

prepare multilingual versions or caDabilitv for trainina oroarams. 



Nultilinoual Presentations are only one asoect of desionina 
multicultural trainina oroarams however. Workers of different 
cultural backarounds must learn how to work toaether with an 
understandina of each other's customs and weltenschuna . Such 
understanding is most likelv to occur through opportunities 
to learn more about other cultures and look at uroblems from 
a broader perspective. To the extent that technology can 
provide «uch ODPortunit ies throuah television, video and 
teleconferencing, it can contribute to multicultural training. 
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Technology Transfer 



Since a areat deal of the research in the instructional technoloav 
domain is conducted for DOD, there is alwavs an issue of transfer 
of this technoloav to the civilian sector. In addition, there is 
a technolooy transfer issue between industry and institutions of 
hiqher education (and psssiblv vice-verse. ) . 



The surest route for technoloqv transfer is the development of 
commercial products and services, once instructional technoloqv 
enters the marketplace, it becomes available and accessible to 
all oraanizations and individuals — provided thev can uay the 
price. Competitive pressures usually force product enhancements, 
reductions in price, and wideninc of marketina and distribution 
channels. Entrepreneurs olav an important role because thev are 
willina to take risks introducina new innovations and spend time 
evanqelizino about their product/service. 



As has been discussed earlier in this report, one of the most 
important wavs that instructional technoloqv is transferred 
from military research to civilian applications is throuah the 
movement of personnel from the military and military contractors 
to commercial organizations. For example, manv of the individuals 
involved in military CBT and interactive videodisc projects durina 
the 1970s and 80s went on to develop CBT and interactive videodisc 
for commercial aDPlications later in those decades. The same is 
likelv to be true for current research with intelliaent tutors, 
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expert systems, automated instructional development and networks. 
One aspect of military research that facilitates this transfer 
is that most work accomolished is in the public domain (orovided 
that it is not classified) and >ence has no contraints on 
commercial development. 



The problem with this form of technoloov transfer is that it is 
not systematic and does not necessarily address the most critical 
trainina needs of individuals, oraanizations or the nation. For 
example, if a market is difficult to reach (e.o., small business), 
perceived as irrelevant (e.o.. elderly) or unfamiliar (e.o., 
minorities), it mav not aet much attention. Another problem is 
that much of this type of technoloov transfer is carried out bv 
small companies with very limited resources who are unable to 
fund the level of develooment needed. Conseouentlv, an enormous 
amount of instructional technoloov developed in the context of 
military, academic and industrial research does not get transferred 
to oraanizations , institutions and individuals where it miaht 
improve learnina. 



HRD Trainina 

It has been emphasized a number of times in this reoort that the 
knowledge and skills of instructors with respect to the development 
and use of technoloov are paramount to its success. Yet, a laroe 
proportion of trainina professionals have little experience with 
or understand ina of instructional technoloov. The increasina 
prevalence of instructional technoloov oroarams at universities 




and th« increased attention to the topic of instructional 
technoloqy by professional orqanizations in the HRD domain 
helps to improve this situation but not in a broad fashion. 

In order for instructional technoloov to have wider usage and 
greater impact, it is necessary that almost everv instructor 
understand how to develop and use technoloov in sophisticated 
ways. This car. happen in only one wav: all instructors must receive 
extensive exposure to the use of instructional technoloqy durino 
their own trainina. Training professionals need to see technoloov 
used durino qraduate HRD oroqrams at universities as well as 
continuing education received at seminars and conferences. Thus, 
universities and professional organizations have a major role to 
play in producing a 3eneration of train I 03 professionals who 
will use instructional technology significantly in their own 
organizations and businesses — but not by merely encouraging 
courses or talks about instuctional technology. 
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For a long time, there has been a split in the HRD profession 
between those interested primarily in "soft skills" (interpersonal 
training) and those concerned mainly with "hard skills" 
(technical training). The use of instructional technology has 
always been seen as the orovince of technical training and not 
very relevant to interpersonal training. In fact, technology can 
be applied equally well to either kind of training. There is a 
need to apply more awareness of human relations to the use of 
technology and vice-versa. The HRD profession needs to look at 
technoloqy much more broadly than it has in the Dast. It should 
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not be viewed so narrowlv but as a way of imorovinq human potential 
and orqanizational orowth. 

■ 

Summar y 

In this chanter, some of the major issues in the trainino field 
were reviewed and the relationship to instructional technolooy 
discussed. It was araued that technolooy could have a major impact 
on Issues such as retraining, basic skills, distributed trainino, 
participative management, team trainino, and multiculturalism. 
Two factors that determine the extent of the impact are technolooy 
transfer and HRD trainino. Unless the results of technoloav-based 
projects are available to the oroanizations and individuals who 
need it, the potential benefits will not be realized very widelv. 
At the present time, technolooy transfer occurs in a larqely random 
fashion. Furthermore, a relatively small proportion of trainino 
specialists have a hiqh level of exDertise usina instructional 
technolooy which also limits the extent of its impact. These 
two areas, technolooy transfer and the trainino of instructors 
about technolooy, need much more attention. 
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Appendix A 

Military Applications of Instructional Technology 

This Appendix summarir.es some of the current initiatives of 
the Department of Defence (DOD) in the area of instructional 
technology with particular focus on basic skills and 
maintenance training. It should be appreciated that military 
training is an enormous enterprise with no centralized 
coordination. This makes it very difficult to provide any 
kind of comprehensive or complete description. Even within a 
given service, there is no single entity responsible for 
managing instructional technology efforts. Thus, this report 
can only hope to provide snapshots of the kind of activities 
being conducted. Futhermore, since a large percentage of the 
instructional technology projects undertaken by DOD are of a 
research nature; many of these projects do not move into an 
operational status. 

Overview 

In an attempt to provide an overview of instructional 
technology efforts in the military, we can examine data 
collected by the Training and Performance Data Center (TPDC) 
under the Training Technology Transfer Program (TTTP) and 
reported in August 1986 (latest public report) . At that time, 
there were 368 training technology projects underway in the 
USAF (33), Army (143), Navy(189), and Marines (1). Of these 
projects, 197 were being conducted by outside contractors, 
137 were being conducted in-house, and 34 were intra-service 
or undetermined. A total of 30 different military 
organizations were responsible for these projects with the 
bulk being conducted by the Air Force Human Resources Lab 
(31), Army Research Institute (136), Naval Training Systems 
Center (79), Navy Personnel Research & Development Center 
(48), and the Office of Naval Research (34). As far as 
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contractors concerned, the projects were spread across 29 
universities and 70 corporations. 

The projects being conducted fell into the following six 
areas : 

1. Artificial Intellxgence - expert systems, intelligent 

CAI, intelligent coaches (43) 

2. Automated Job Performance Aids - decision support 

systems, authoring tools, automated ISD (18) 

3. Computer Based Instruction - tutorials, simulations, 

games (86) 

4. Embedded Training - operational systems with training 

built in (6) 

5. Interactive Videodisc (IVD) - computer controlled 

video (11) 

6. Simulators - trainers for operational equipment (82) 

While the TTTP report is now a little dated, it does convey a 
fairly accurate picture of instructional technology efforts 
at the present time. However, in the past five years, more 
attention has been focused on embedded training and 
interactive videodisc with less emphasis in the areas of 
computer based instruction and artificial intelligence 
(although these are still important areas) . 

Basic Skills 

One area of considerable importance to almost all branches of 
DOD is basic skills instruction. Many recruits enter the 
miliary service with major deficiencies in reading, writing 
or mathematics skills that handicaps all further 
learning/training activities. The nature of these 
deficiencies and attempts to correct them are well described 
by Thomas Sticht (1989). Sticht's functional literacy (FLIT) 
approach has been the basis for basic skills programs in the 
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Air Force (JORP), the Army (JSEP), and Navy (JOBS). The basic 
thrust of the FLIT approach is to encorporate basic skills 
instruction in any entry level training program, thus putting 
literacy in a functional context. 

There have been two major basic skills projects in the 
military based upon the FLIT approach that involve 
instructional technology: JSEP and SDMS. The JSEP project is 
described in detail in the main body of this report. The 
Spatial Data Management System (SDMS) project was an attempt 
to use interactive videodisc to teach basic skills in the 
context of map reading and navigation skills. This project 
was conducted by the Human Resources Research Organization 
for the Army Research Institute in the early 1980s. It did 
not continue into an operational phase, although it served to 
demonstrate the potential of IVD for basic skills training. 

Maintenance Training 

Military readiness depends heavily on the effective 
maintenance of equipment. Consequently, maintenance training 
is a major focus of DOD training efforts. Over the years, 
there have been many attempts to use instructional 
technology, mostly in the form of simulators, to improve 
maintenance training. Orlansky & String (1981) provided the 
definitive study of the cost-effectiveness of maintenance 
training simulators showing that the simulators resulted in 
improved job performance, reduced training time, and lower 
costs relative to the use of actual equipment for training. 
Subsequent studies have simply reinforced the conclusions of 
Orlansky & String. 

The use of instructional technology for maintenance training 
has focused on simulations involving computer based 
instruction and more recently, interactive videodisc. For 
example, in 1987, the Air Force Communications Command (AFCC) 
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fielded 92 interactive video systems for electronics 
maintenance training on the AN/GRN radar and test equipment. 
The IVD system delivered on the job training for skills that 
had previously been learned only through apprenticeship. The 
project involved a detailed follow-up on 160 trainees; 
however no comparative evaluation of the IVD system versus 
apprenticeship only was conducted. The follow-up study 
indicated that the system was effective when used but 
difficult to integrate into the workplace (see Slater, 1988) . 

A research project conducted by the Navy investigated the use 
of interactive videodisc as a tool to evaluate job 
performance in electronics troubleshooting (Kidder & Laabs, 
1988) . The preliminary results indicated that interactive 
video simulations provided as good a testing method as hands- 
on tests. In another IVD project for maintenance training 
(Nicholis, 1990), the system was used as a job aid to help 
trainees isolate faults. The study concluded that the use of 
the system reduced skill requirements, repair times, and 
reliance on technical manuals. 

Other Applications 

Current applications of instructional technology in military 
training are very diverse and involve all of the technologies 
discussed in the main body of this report. Here is a sampling 
of current projects: 

• Computer Assisted Medical Interactive video System (CAMIS) 
- Medical Heath Sciences Education & Training Command, Naval 
Medical Command. Over 25 interactive videodisc courses in 
basic medical skills and medical knowledge areas have been 
fielded and many more are in development. 

• GUARD FIST II - Army National Guard. A simulator employing 
IVD and computer-generated imagery will be used to provide 
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tactical training in simulated battlefield scenarios. The 
simulator includes all equipment normally used by the Forward 
Observer MOS 

• Piloting and Navigation Team Trainers - U.S. Navy. A set of 
simulators that are used to train navy officers on ship 
navigation and piloting skills. .These simulators provide 
realistic presentations of shipboard equipment and use a 
variety of hydrographic databases . 

• 89- OBT ASW Trainer - U.S. Navy. The OBT-89 is a simulator 
that provides embedded training for the AN/SQQ-89 sonar 
systems installed on surface ships for Anti-Submarine warfare 
(ASW) . The OBT-89 allows an instructor to program the AN-SQQ- 
89 for training exercises. 

• Student Evaluation System <SES) - Air Command & Staff 
College, USAF. A computer managed instruction system 
involving computerized testing and student administration o 
used to deliver distance education to over 500 students in 70 
locations worldwide. 

• Army Logistics Management College (ALMC) uses satellite 
telecor. "erencing (one-way video, two-way audio) to teach 
logistics at over 30 sites. The televi?ed courses have been 
taken by over 13,000 students. 

Effectiveness 

There have been many effectiveness studies of instructional 
technology in military training settings. A general outcome 
of these studies is that relative to other training 
approaches (usually classroom lecture or apprenticeship), 
instructional technology results in the same or better 
student performance regardless of what measures are used 
(e.g., achievement, job performance, retention, time on 
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task) . Futhermore, technology-based training almost always 
reduces student completion time relative to classroom 
instruction by 30-50%. These outcomes are well-documented for 
CBT and simulators by Orlansk* & String (see Orlansky, 1986, 
for a summary) . More recently, Fletcher (1989) has summarized 
the results of evaluation studies for IVD. 

While there are many methodological problems with these 
studies, it is clear that instructional technology is 
effective in most settings. However, instructional technolog> 
is often not successful because of implementation problems. 
For example, one factor that strongly determines the success 
of technology-based training is the degree of involvement of 
the instructional staff with the technology. It has been 
repeatedly shown that if the existing instructors are not 
significantly involved in the design and use of the 
technology, it is not likely to be effective. In other words, 
implementation considerations, rather than inherent 
characteristics of the technology itself, are usually the 
limiting factor in its successful use. 

Transfer to Civilian Training 

The fundamental question of this study is the extent to which 
instructional technology can contribute to increased U.S. 
competitiveness. What impact does military use of 
instructional technology have on this question? 

First, it should be noted that a sales of U.S. developed and 
manufactured weapon systems generate enormous revenue for 
U.S. companies. These sales usually include training support 
and to the extent that technology-based training programs are 
available, they are included. If such technology-based 
training systems are seen as providing more effective 
training, they could enhance the marketability of a system 
and hence make U.S. companies more competitive in this arena. 
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Secpndly, it should be observed that a large proportion of 
enlistees leave the service after thei • initial tour end 
enter the civilian world. Thus, DOD provides technical 
training which is then utilized directly by the commercial 
sector. To the extent that this training is made more 
effective through the use of instructional technology, it 
makes new employees more skilled and hence increases the 
competitiveness of the companies hiring these individuals. 

Another effect to be taken into account is that the military 
support for instructional technology creates a large pool of 
companies and individuals with expertise in this area. These 
companies take the systems and expertise developed in the 
context of military training and apply it to the civilian 
sector. This can take place directly through services and 
products, or indirectly through personnel transfers. 

Finally, there is the possibility that systems and curriculum 
developed for military training can be directly used in 
civilian training. To the extent that this training provides 
more effective instruction, it would improve the quality of 
worker skills and hence result in more competitive companies. 
The Training Technology Transfer Act is an example of 
legislation that could faciliate this process. Indeed, this 
Act is already being employed to transfer the JSEP program 
into civilian use. 



Summary & Conclusion 



Instructional technology is widely used by the U.S. military 
for all types of training. Basic skills and maintenance 
training are two areas that have received some attention, 
although many more projects are underway in the latter than 
the former. Evaluation studies of instructional technology in 
military training consistently show that is as effective or 
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more so than existing classroom or apprenticeship methods. To 
* • the extent that instructional technology increases the 

effectiveness of military instruction, it contributes to 
W increased competitiveness in the civilian sector. 
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